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The DIALIB Project was a 3-year experiaeiit that 
investitrated the potential of the .public library as a "linking agenf 
between the public? antl/the many afachine-readable da*ta bases currently 
accessible via the telephone using online termihjals. The study 
investigated the following guestions: (1) Is onidTne search of use to 
the patrons of a publicf" library? (2) Hhat impaci? does^;^jiich a system 
have' on both , the" library and the patron? (3) What conditions are 
required for successful use of online reference search in the public 
library?\f4) what'are the financial and marketing a^pectiS of ^6uch a^ 
service? iPhe four participating Cboperati^ve' Information Networks 
libraries^performed 2/173 searches during the pro^ject. The principal 
user groups were* graduate students, educators, . tea|inical ^ 
professionals, a&d librarians. In planning for '6n\iiie' search in the 
public library,- nine key requirements were icientified. It was 
det'er mined that a ^market .exists for p^ublic library searches of ^ 
existing data bases among employees and oper.ator-s o'f small ' 
^businesses, college students^ and local government officials* The 
tradltiona^lly trained public? librarian ao^s have skills ^that are 
applicable to the skills required for online .?^arching« Contrary to 
expectrfttions, no problems weife experienced in the mechanics of 
billing and fee collection, and comments from patrons were* favorable 
to paying , for the* service. tAuthor/JAB) 
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This report' presents the results of the^IALIB project, a* study supported by the 
National Science Foundation, * to investigate online bibliographic search in a public* 
library setting. We hiive attempted to capture not only the formal evaluative material, 
but also the very Valuable infortaal 'comments expressed by participants. , 

The report is given in two volumes: . . * . /. . , 

» if* • #^ • 

Final Report s This Volume, describes -the project, and summarizes the evaluation 
material giVen in the Annex^ - « , ' ^ / 

Annex : Evaluation Report. This ^volume presents the det-ailed project evaluation^ 
prepared by Applied Communication Rese^chf It provides qxtensive st^igtical tables, 
and detailed analyses of the results obtained. 

Copies of the two yolujaes are available f^-om Lockheed Information Systems while the 
supply lasts, and therealter from the National Technical Information Service (NTIS). 
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Note: Any opinions, findings, conclusions or recommendations expressed in ^his 

pu'blicatioi^ are* those of the authorip and do ftot necessarily reflect the views 
, Qf the National Science Foundation. 1 
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EXECUTIVE SUMMARY 



This executive summaj;/^ folLpws the same general structlfte as the ^jeport; the reader 
can r^fer to the appropriate section for further information oh any , of the topics. 

I. .DESCRIPTION Og THE STUDY . ' " . , . * ' 

The DIALIB Project was a 3rye^r expeijiment that investigated the potential ^of the • 
^public library Ols a Unking agent" between the public and the many madhineJreadable 
data bases currently accessible via the telephone line using online term^als, ' Free 
service was offered for the fir^t year, on^-half the cost of the search service charges 
were, passed on to the pati:on for the second year, and the full cost of search service 
was charged in the third year. Four 'public •libraries^ia Northern California,' ^member? 
of. the Cooperative Information N^twolrk (CIN),. *were tlje major participants in the 
study; additional' libraries in ojther pa;:^s of the couutry wer^ntroduced for §l 6-month 
. peri^U in the;4niddle of the second year to obtain subjective ev.aluations. ,Two of the 
original CIN libraries carried through for the third year. The substantive Evaluation 
data* were obtained from the GIN libraries; the other libraries provided subjective 
comments and evaluations, ^ * ^ 

The study invesfigatecj the following questions: * *^ .| 

• Is online search of use to-the patrons of»a public library? ' ' / 
4# What' impact does* such a syStem ha\?e^on i)oth the library and the patron? 

• What condi^^ohs are required,for succe^ful use of online reference search 
in the public libjary? 

• What are the financi<il and marketing aspect^ qf such a^service? * 

The investigation) was conducted by_Lockheed Information Systems, and Lockheed also 
provided the (DIALOG oniirie information retrieval service.. Evaluation wa^ performed 
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by ApplLejd Communication Research (ACR), a nonprofit behavioral |:esearch firm in 
Palo* Alto, California. The project was reviewed by an oversight committee of five 
experts in various specialties of public librai;ianship, marketing, tod information 
science. * • *' * 



During the DIALIB experiment, ACR gathered jdata on user characteristics and 
altitudes, cost of search, offline and online search time, data bases used,' etc. In 
add^ion, -through iniervie,ws with the participants and statements subrhitted by the 
participants, some of the intangible aspects of the experiment, were documented. 

2. ONLINE REFERENCE R4ETRIEVAL ' _ - • , 

The Lockhee<^DIALOG_Infoi*mation Retrieval Service was usedln the study. The 
libraries accessed the systeYn-using a tj'pewriter-like terminal that is acou^cally 
coupled to the telephone line. (An ordinary handset'^is placed in a receptacle of the - 
terminal; )^ Approximltelt 18 data bases in education, science, technology; social 
science, and busi^j^s were available at the start of the Project. This gcew to 36 data- 
bases by the end of the seco;id year, and to more thai>60 by the end of the third year. 

3. EVALUATION ^U^MARY ' ' / ' ' ■ ' ' 



♦ Are th^ results generalizable to other public libraries? ' *^ 

A great similarity of time and cost elements was found between pairs of libraries 
during -the pay period, despite differences in library populations, organizational struc- 
ture, etc. The time and cost data^ should therefore^e applicable to other public 
libraries. There are differences in subjedtivs judgments on various aspects of online 
search in the' public library, as indicated in the comments ^ven in Appendix B, but we 
feel that Tibr^rians will be able to find comments and information pertinent to their 
rlar4ibrary-^tuationi « , x . ' ^ , 
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• How many^searches ^yere performed? . ' n. 

■ ; v., '• 

The four CIN libraries performed 1, 236 searches jiiiring the first year ,of tree service, 
and 611 searches during the second year when pne-half the usual DIALOG costs were 
passed on to the patron. In the third year, when full DIALOG j^os'ts were cliarged, 326 
sedrches were performed by the remaining two libraries/ , * ^ - ^ 



• '^Who were^the users of the service? 



T^je principal user groups were graduate students, educators, techhi^cal professionals, 
and librarians^. Most online searches were requested either as part of the patron'^ 
job oy for -research papers. ^ - ' J : ' . ^ 

• Were the users satisfied? , 1 . ' " ' 

About TOCc of the patrons during both the fr^e and pay period^ indicated that the results 
of theif search were of si^jgnificant value to tlteni. 

• What is the cpst^of a search? ' \ ■ ^ • . v ' 
" . ^ " • ft." ^ 



Aa average search cOsts about $,6 in staff time Xabout one hour of offline preparation 
and online sep^rch), and about*$20 in online search charged (about for online time 
and ^9 for printouts); This dcfes not include the terrhinal cost of $12f5 a month/ About 
60% of the se^rcj^es had a search service cost of less than' $20. • • - 

'• Should the uger be^pyesent'at jbhe searoh? ' * \ . * • ^ 

'"the user was invited to be^fesent while the search w,a»§ conducted more frequently in • 
the pay period (SOTc) than ih the free period (157o)» This supports previous- findings ^ 
that experienced searchers tend to allow .the user ,to participajj^ in the-search more^thari 
do les$ experi^nce.d searchers. In addition, fears that patipn liresence slows down the 
search provedjo he unjustified,, mrticularly in, the pay period. 
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• What does it take to malke online service "come^live" in ^ public library? 



Personhel and funding determine whether online search cemes ^alive; the.attitu(jes and 
support of th^ library director and the head reference librarian are crucial to the suc- 
cess of the venture, tJnless both are firnoly committed to work for and support online 
searching, tjfie probability of success is at best marginal. The personalities and com- 
mitment of individual libraristns are also a key factor. 

A source of funding must be found to cover the staff costs, search service costs, 
terminal rental, and communication casts, ^These funds may be 'provided through the 
library budget^ through u^et fees, or a combination of both. 

• ^ What background should the pu^ic library have for online search service to be 

' successful? ' ' ' ^ 

It is important that the library ha^ some experienge in dealing with in-depth referenc 
questions, and have identified thM^get group of users of this service. 

• What impagt has the DIALI B' experiment had^in the field? • 

... ■ —7* i ^ ^ 

* ' ' , * ^ ■ ^ •* - ^ ' ' 

Great interest was^ shown in tgie^any '^jers and presentations given during Qie 3-year 
period, and over 600 copies of 'the Two-Year Interim Report were distributed, 

, ' - ; ^ ^ • . , '.^ , . . 

(We have not investigated wh^lier any public libraries have ^ begun offering. online - 

Reference as a result of DIALIB; we encourage any such libraries to contact us so that 

we can incorporate this inforiAation into future editions of this' final report.) 

• Did all the DL^Ig libraries continue to offer online service? * 

Tw6 of the four CIN libraries fiave. retained online search service, San Jose Public 
Library and San Mateo County Library, Of the other libraries that participated for 
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6 months,, Minfieapolis qNFOftM), Tulsa City-County (INFO II), and Cleveland (Facts 
for.' a f'ee) have retained online search. The Long Island Librar*^ Resources Council 
offers online search only for very spefial requests, while Houston no longer offers 
the service, . ' , r ' ' ' « 

^ • What would you jo differently if you were repeating this'' experiment? 

JVe should have planned how to deal with various levels of demand. In particular, 
during the 1 year of unrestricted free searching, the demand for the. service was too 
great for convenient library operation. Each of the CIN libraries should have Set a 
limit on the number of searches that could be handled online, "and established policies 
concerning use of online services. This would haye avoided the overload condition 
during the first year, and would have made the Kbi^arians more tenable to publiciz- 
ing the service during IJae subsequent pay periods. * 

-, ^ ^ 

We found that branch librarians' are.reluctant to solicit requests for'^onli^e search 
when a •central libra^ry^ is perfo-rming the actual search. Since' much of this reluctance 
i§ due to lack of acquaintantje with: onling search, and a lack of feeling of participation, 
we should have twined at least one person in each branch |;o^ct as the "local agent' 
? of online* search in the b?:afii5h. > ' • * * ' 

* . - - ^ '\ ^ ■ 

^ / 

. 4. PLANNING FOR ONLINE SEARCH • ' , - 



Nine key requiremjerits for online gearch in thejjublic library were identified: 

(1) Ne^b establish the scope and limits of .service ^ 
^ *(2) Need to carefully consider fhe impact of the service on staff time ' 

(3) Importance of -staff attitudes toward the role of reference services, dnd 
toward fee-bas(Bd*search (where applicable) 

(4) Importance of obtaining suitable funding fot both the search service and'the 
supporting staff , ^ • * , » 

^ (5) N^ed for promotional planning » < ^ ' „ 

(6) Need for ongc^ing^staff training ' • > * 
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(7) -Isfefed for a "Qriticahmass" of searches to maintain staff proficiency 

(8) Need to maintain* adequate support documentation 

(9) . Need for developmg management and evaluation policies for the onli^[le 

service ' . • " . ^ * 



Although all the public librar|||g in the DIALIB study used the fee-for-service approach, 

online search and fee-for service are not inexorably linked. However, if free sei:vice 

is to be offered, it is crucial that policies b^'set up that assure the ability of the 

library to deliver effective service to its chosen clientele.* Xhis was not don^ during 

the DIALIB study free period, and the CIN librarians were overwhelmed by the de- 
ft 

maud for online searches. . ^ ^ 

■^.^ ^ " ' ' ' : ■ ' ^ 

5. CONCLUSIONS 

• - Marketing ; - . ' ■ ' ^ 

'■' • ' ' ' '' ' ' J. ^ 

The DIALIB experijpaent has shown that there is a market for fisting data bases. It 

is made up pf employees of small businesses; of students from colleges and universi- 

ties who dor not otherwise have convenient access to online searching; of individuals 

who are starting a. business, doing personal research or investigation; and .of local . ^ 

govjernment officials. Other users of the service came from government agencies of 

all size & and descriptions, and small high -technology firms. . ' 

* » 

Online search and the public library ' ' " - 

The traditiQnally traine(5 public librarian does have a variety of skills that are 

^ ' \ • * 

directly applicable to the kinds of skills required for gnline searching. Mahy librarians 

involved in DIALIR, who had no previous training in online search, became skilled 

'^eajrchers, Howev^^r^ the majority of public. librarians spend very little time in 



lertgthy, in-depth, personalizfed'searQhe&for a patron^" and the availability of online 
search in the public library ra^es .philosophical questions of liow much. service is, to 
be prodded for whom, when, where, and at what*level. ' 
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. Fee for service the pul^Uc library ' . • . ^ ' . 

An important tism, of the DIALIB experiment was that, contrary to.^expectations, no 
problems were ey(per|encedto the mechanics of. billing and fee collection- anji that 

^ comments by the patrons vvfere favorable to paying a fee f^)r the search service. The 
only problem associated w)ith charging for this specialized referltacQ service was 

• dealing with thfe philosophical cdncept'of fee for service. Once this was accepted by 
the admiriistrmon, the actual mecjiahics of collection and patron acceptance offered ' 
no difficultiei.^ Furthermore, there has been no tendency to extend the concept to 
traditional afervices within the participating libraries. We should note, though, that 
since a study of non-uers was not made, we do not know whether fees deteVred some 
individuals|from using the service • . . 

In this finjll report wq have ^ried to indicate the time and cost elements, and the many 
organizationar^d staff aspects involved in online search in the public library. , We;t» 
. hope that/such factual information will be useful^to those on.,both sides of the fee-for- 
service question. " • , 
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■ DB^CJRIPTIO^ QF THE STUDY, 

^ It is now possible to perform" online cVpurer searches of large Jbibliographic data 
♦ bases ranging from onerquarter of a jniliion ta over a million citations each. These • 
(lata bases span % spectrum from sciaickan.cl technology to social sciences and" 
business. Several retrieval services sufcEastbe Lockheed DIALOG®' system and the 
. System Development Corporation's ORBlT system offer such sl^vice at rates ranging- 
from' $35 to $150 aij hour, depending on the data base used. In addition, th^ user must 
pay the communicatioji co'st (the cost of a direct telephone call to Oalifomia or 
approximately $8 an'hour via a local Tymshare br Telenet port) and terminal rehtal . 

■ .cost (approx;jpiately $160 a month, including ma^ntehance). / 

' A decade ago-, sUcj> online access to large. bibliographic data bases was resfilcted'to 
large governmental organizations that had the financial assets needed to prepare"^ large 
data bases and td access them in an efficient manner.. As a result of reduced computer 

. and communications costs, .^is access has^n extended to industrial users, and 
univorsities at a reasonkde cost through more than 15 service"s in the United States 
(Ref.- 1). As yet, however, no ext^sive use of these services is made, by the general 
public. What is required, as sho\^^chematicaUy in Fig. 1-1, is a "linking agent" to 
bring tbgether the data base resources and the general user public. 

' 1.1 THE DIALIB STUDY ' ■ ' ^ . ^" 

, In late 1973', Lockheed Information Systems submitted a proposal to'.the National • ' ^, 

■ Science Foundation to conduct a fitudy to examine means by which the public library 
could act as a lirikliilfe agent to^the general public in providinrbnline information " ' ' 
.retrieval services. ' * ' ' " ' 

In 1974, th6 User Support Program 'of the Office of Science Information Service,* 
.National Scfence Foundation, established a ^ant-to enable Locidieed Informatiofi * 



♦Now the Division of Science Information. 
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^RESOURCE system' 
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DATA BAS^S INf , 
SCIENCE 

• TECHNOLOGY 

• BUSINESS , 

• SOCiAL SCIENCE 

• EDUCATION 



• PUBLIC .LIBRARIES 

• UNIVERSITY LIBRARIES 

• PRIVATE SEARCH SERVICES 



\ 



; • ClTY AND' COUNTY GOVERNMENT 

; • PUBLIC SEI^VICE ORGANIZATIONS 

• SMALL BUSINESS ' ■ - 

• PRIVATE^^^DIVI DUALS . - 




Fig. 1-1 Concept of a Liiiking Agent Between the Public &|id Inforitiation Resources 
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Systems to worl^ith the Cooperative Informatibn Net^v;p;:k (CIN), an information . 
cooperative in* Northern California, to establish online search services Using the 
DIALOG Systefn (see Appendix E) in four Cooperative Information Network public 
libraries. The project is^ referred to as the DIALIB ))roject. -jApplied Communication 
Research, Inc-* (ACR), a nonprofit behavioral research firm in Palo Alto, California, 
was selected ,tQ perform afi independent project evaluation. 

♦ * * * • * 

The -NSE grant 'summary w'a§ as follows: • ^ 

The purpose' of this project is to conduct an operational experiment to test 
the feasibility, economic viability, an(5 utility to users ol using the existing 
library systems to 'pi:t)vidQ public access to computerized (online) scientific ^ 
and technical informatioii services (query, search, and retrieval) hereto- 
fore Imavailable and inaccessible to either the general public or the scien- 
tist/engineer in smaller organizations; and to deter niine the impact of 3uch 
services pn both libj^ies and service users. The project entails -a two- • f 
^ ^ year program to be. carried oijt in several libraries o'fThe Cooperative ' . v 
* IMormation ^^etwork of San Matep and Santa Clara vCoimtms in California. 
The online retrieval capability, which will be provio^ditSy the Lockheed' ' 
DIALOG system, otfers access to a wide range of engineering, science,, 
• ^ psychology, agricidture, and educational technology data bases," including 

NTIS, OAIN; ERIG, INSPEC.COMPENDEX, andTANDEX.. Statistical tota: 
are to be <;ollected and analyzed 'with respect to (1) utility and utilizatioir 
of public libraries as technical information dissemination centers, and 
0 . (2) marketing variables and matketing methods for inotivating new users 

of services prQvidirig online access to scientific and technical informa^on. ^ 
Basic study areas include the investigation and "analysjs of the finaiKJial, 
administrative, jaser, technical, and marketing asp^cte Pf computerized ^ ' . 
online information seWices in relation?.i6 other library services. 

Thus, some of the objectives of the study were the following:' , 



(1) Determine how useful an online retrieval service is in meeting thB, needs 

of the general public .v.- - * ^ 

(3) JD^velop a user profile that will assist library administrators in identifying 

the principal users of the system, the abilityVffpatrons to pay for system 

use, and the type of inforriSation patrons require* / ^ 

(3) Examine the effect of the online servipe on the library reference service 

and isolate causes for acceptance or rejection of the service.. 
^4) Determine the actual costs of providing such a service and outline tlie 

factors contribujting to these coi^ts. 

(5) Identify the specific characteristic^ of different libraries which would hav-e 



an effect on the operatirai^ 
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September 1976, the National Science Foundation extended the time •period one 
additional year so that we could obtain evaluation data on the impact of/cHarging * ^ 
Ijatrons for the full cost of se^ch, as well as to develop a more complete conceptual 
framgwork for the study. * ^ / ^ 



. It^ust be kept in mind that the experiment involved public libraries^operating imder 
different administrative policies and jiot imder strict e>qDerimentaI control. Xhus, " 
When we ^^y to communicate th^ rfes«itg^f the study-, we are like tiae blind men inj^khe ^ . 
fable, -each touching .a dif^^rent part of the elephant, and tr^ng to communicate the 
nature of the creature to others. ' < ' " 



r 



DESIGN OF THE STUDY 



\ 



The study was originally designed as a 2-year^<a*;udy in which the first year of online 
service was to be provided ^t'no cost to the libraries, and the second year was to be 
at Ane-half the usual ch^ge for search time. Th\ four CJN-member public libraries 
were to determine how the funds for the second-year operation were ^o be raised. 
Becg^ifee (k^ severe budget cuts experienced by these libraries,, they all chose to pass' 
the online search service cosifs on to the patron^ while they paid fot library personnel 
andjconimunication costs. (The terminal rental, about $125 per month, was paid by the 
grant.) During the third. year of tihe study, the full cost of online^search service y^sis 
al^o passed on to the patron^ , ' 

The libraries each determined how the online service , was to be integrated into their , 
system. Since each qf the librarieis^was in a different county/city jurisdiction*, and 
was organized somewhat differently from the others, different .approachei^ Were'taken 
to^serving the publip. There was,, therefore, variation found in the evaluation data 
•'from library to libraryr and this .variation is discussed in Volume n of the Two-Year 
Inte rim- Report (Ref. 2). , \ " 

- . ^ ^ ■ .... ; 



' 1-4 ■ 



LOCKHEED PALO ALTO RfrStA^CH LABORATORY 

lOCKHIIP MllflllS SfACi company; INC 

A SUMrOIAlY OV iOCKHffO AIICIAff. COIPOfAlt'oN 



•LM^&D 560986 



1.2.1 Project Coprdinatio/ ^" 



In the early afages of the project,, monthly revim meetings were\eld to ivon out 
difficulties^ to 4-e^ew the ACR evaluation requirements, kvt%hy fhe^second^^ar 
.v^ry few meetings were -required. The- libraries al|b submitjed^monthly repoi-ts to 
LockhWd, /indicating problems, experience with the s/st^m,' abd suggestions, and 
these reports were then circulated to all the participating libWieey. 



4> 



1.2.2 Publicity ' • ' • 

Public libraries have always had the problem of publicizing their service to attract 
the attention of potential patrons. With the inception of onHne retrieval service, and 
particularly with fe6-based^a!hsk; this becomes an even "greater p>ot)lem.i' ' 




Early in the project it was realized that a publicity expert was required to coordinate 
and develop publicity for the online service, and the CIN 'Online Committee recommended, 
Mrs. Evelyn Helmer , Public Information, San Mateo County^ Library. • Her lour- ' 
gtage publicity plan is given in Appendix D. ^Th^raries ^se to use minimal- publicity' 
during the second ffnd third years because they felt t>at tjiey could not devote st^ to a " • 
large demand. ' ^ ^ ; 

• " 0 

J 1.2. 3 Librarian Training , , • ' 

Librarians from each of the participating libraries were given the standard Lockheed 
2-day training course, ^nd they^spent about 1 month familiariWg'themselVes with 
the system before deling with patron searches. As time wdnt by,:skilled searchers 
.left and others were trained to take their place , visually by sending them to 'the ^ " " 
Lockheed training prAra^. m addition,* librarians attended special' data base 
presentations- such/as thos^ given by Predic^te'or by Bioscience's, Information ' v 
Service (BIOSCS) in nWarby cities. ' • i 

' ' ' I / ■ 

'Searchers received the DIALOG^CK'ronolog, a monthly publication d'escribing the 
^latest features of the system, offering hints on system use,, ai^l ind^king character- 
istics of the latest data bases available. They also received "DIALIB Notes an . 

■ ' 1-5. „ ■ 
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informal series of notes *bat discussed their common mistakes in searching, new 
data bases, and interesting ,?fearch techniques." DulrlDg the' second year/ searches 
were reviewed and the results!df this review were discu:$sed in these DIALIB' nates, 

It mjist be kept in mind that DIALOG was in a period of rapid expansion during this , 
2-y^ar period, during which time the.number of data bases increased fr9m about 
18 to over 35. In the third year, the, number of data bases increased to over 60. Thus, 
in some of the remarks of the remarl^ of tl^ participating librarians given in. ^ 
Appendix B, one will find statements about the lack of time they had to keep up with this 
rapid grawtl\. - • * ' 



1.3 ROLE OF THE 



STUDT^ARTICIPANTS 



The following organizations paxtibipated in the study. Their specific responsibilities 
with regard to the 'study are inciujated. 

• Joint Board of the Cooperative Information Network (GIN)- GIN is an organization 
consisting o£ representative^ of public and priVat^ libraries in S.an Mateo and 
^ta Gl^ra Counties^ in Galifomia, wiiich has-been in existence for nearly 5- yftar s 
It's purpose is to deal with mutual problems, share information resources, and * 
coordinate jbint activities of^the member libraries. The role of the Joint Board 

of GIN in the present study was tcreview overall progress of the stucly, and make, 
policy decisions,! as required. * ^ ^ >^ 

^ GIN Online Retiueval Gommittee. This committee was appointed by the GIN Board 
to act as. liaison with Lockheed Information Systems. The Online Commie 
consisted of Mi:s. Patricia Bergping, Burlingame Public Library, and Mr. Don^d 
Fuller, Santa Glara (Gity) Public Library. ' / • ^ 

• Lockheed Information Systems . Under Dr . Roger K. Summit, Project Director , 
and Mr. Oscar Fir^chein, Principal Investigator, Lockheed Rrovided the overall 
management, technical guidance, and neordination. In addition, Lockheed was 
responsible for providing the DIACOG online, retrieval service, and training of 

' library pe^onnel. Lockheed prepared periodic reports^or the National Science 
"Foundation, conducted review me^eting^, and reviewed searches performed by the 

libraries.. • . * . ' ' ^ 

f * — . . ' 
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• Applied Communication Research . 'Project evalua^ionAvas initially the responsibil- 
ity of Dr. Alice Ahlgren of Applied Communication Research, Inc., a Palo Altg. 
nonprofit behavioral research firm. She wa^ responsible for. preparation of the 

•'evaluation tools, coordination with the libraries concerning 'their use, and analysis 
- and reporting on the results. During the third year, Ms. ^ Carol Van Jepmond a^ 
sumed th.ese duties under the supervision of Dr.^olin Mick. * ^ . ' 

• Oversight Committee . To ;ceview thre progress of the experiment, an Oversight 
Coi|imittee- consisting of impartial experts in the fieldfot experiihental design., 
public library administration^ and user studies was formed. The committee 

; consisted of Professor A. Rubenstein (Northwestern University), Mrs, Virginia 
Ross Geller (Geller and Ross), Professor Charles Bourne (University of California, 
Berkeley), Mr. Forrest Carhart. (METRO), and Mr. Douglas Ferguson (Stanford 
Libraries). Comments of feeve^l meinbers of the Comn^ttee are given in 
Appendix ' - \ - - 

CIN Libraries .* In June 1974, the CIN Boa^d selected four libraries for the eXperi- 
ment^ with each library representing a sonxewhat different type of library service: * 
a large city (San Jose Public Library); ^ county library in a suburban area (Santa' 



Clara, County Library at Cupertino|; a county library headquarters with very little 
walk-in traffic (San Mateo County Library, Belmont); and a smaller city library 
with much walk-in: business (Redwood.City Publit'Library).' The libraries provided, 
the services of the reference librarians, paid for communications costs, arid pro- 
vided space for the terminals. In addition, the librarians gav^alks and presehta- 
tions^to various eivic and governmental ofganizations to publicize the servige. 
Figures 1-2' and 1-3 show the terminal locations in the four CIN libraries., All but 
the San Mateo County installation are'in patron areas.' 

• Non-CIN Libraries .* After the first year, the NSF suggested that the experiment- 
be expanded to include tliose libraries able to^eal with nonsubsidized search. The 
^intent was to obtain experience in pas sing jfie^full cost of the se^ch o^ to the pubttq 
library, ^ew libraries would be given free demonstration time' and a free terminal 
for a 6-month period, but would be billed at full cost of a DIALOG search. The 



♦Descriptions of the libraries are given in Appendix A, Library Profiles. 
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libraries could then pass this cost on to the p^ron, if there was no internal budget 

to support this service, s would provide data on tiae acceptance o| a full- charge 

• system, by the public. Four public libraries agreed^to. participate m me project: 

. Minne^olis Public Library (INFORM); Cleveland Public Library (FA€TS FOR A 

FEE); Houston Public Library; and the Long Island Librairy Resources Council • A 

complete description of these libraries and their participation w;as given in 

Appendix A of Annex 1, Two Year Interim Report, Ref 2. In addition, the Tulsa 

City-County ^^ibrary (INFO JJ) was provided wit^i training and demonstration time 

during "the thir^ryear. The comnuents of the non-CIN librarians are given in 
j , V ^ - T" ♦ , > ' ' , * 

Appendix B of 4he present report;: 

1.4 PROJECT-CHRONOLOGY \ ' 



ERIC 



The highlight events of the project^ atr^^^\^n below. Details were given in the 

Quarterly Reports indicated. AliSt b^ pfepject meetings and papers presented is 

given in Appendix r. . , ' * , . . ' 

Junfe — August 1974 (First Quarterly^epoyt) 

^ • Participating libr^ies selected by CIN Board. * 

• Legal agreements prepared and signed between the librai'ies and Lockheed. 

• Oversight Committee* selected, and had'iirst meeting at Lopkheed Palo-Alto 
Research Laboratory. . # 

• Opening ceremonie's at the San Jose Public Libr^, with attendant publicity. ^ 

• Meeting' with heads of participating libraries regarding pricing policy for 
second year. ' ' ^ * ' 

' * Installation of terminals, training of -library personnel, and initial operation. 

^ ^: ' . ^- . . - ^ 

Septembex-^NQvembeV 19^4 (Second Quarterly Report) ^ / • / • 

• User evaluation begun by ACR wi^K distribution "of cfuestion^ires and forms . 

• Problems arise because high patron use of the system overloaded the refer- 
ence^staff. • - . ' • . 

• Publicity plan, Stage 1 (distribution of bookmarks^ posters; and brochures), 
and Stage 2 (grpmotional mailings to Ipcal business) carried W. Many news- 
paper stories appear in 4ocal^press. . ' * / . * .^^^ 

, • ■ . 29 -'ho ~ . " ' 
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i • December 1974 - March 1975 (Third Quarterly Report) 

• Intensive preparation for the fee portiomof the study. Participating libraries 
depide that restricted budget makes it impossible t© budget afly library funds' 

^ . for project, and that all such posts will be passed on to the patyton. Members 

of Oversight Conimittee 'express disappointment thkt not even tolfen funds are 
forthcoming from libraries, 0 • , ' ' 

' • because. o|^the high level of search activity, participating libraries request * 
financial support for search personnel. .NSF approves a $10 per termin4 hour 
subsidy for this purpose (demonstration time is npt included). 

• • "Standard search" prpposed by Lockheed because of concern expressed by 
librarians concerning cost of search to patron. 

• Crisis at San -Jose Public Library because of apt overload condition created 
,>y'San Jose State University students.^ A request was made from the library ' 
\o the City Council that it be allowed to ^thdraw from the project; request is 

denied because of use to community. San Jose Library School provi^s a 
graduate student to deal with overload, and situation is resolved. 
. • Legal form for fee period is developed by libraries. 

• Oversight Committee meets and discussers the San' Jose situation, the need 



for development of aj pricing .policy, and the need for more interpretation 
in the evaluation data. ^ . ,^ 

• Publicity efforts are cut back because qf^high system use. 

" June- 1975 - August 19^5 (Fourth Quarterly Report) 

- • Initiation of fee fPr service. No fee collection difficulties are experienced. 
Number of seatches drops to 10% of previous free service searches. / 

• ACR completes analysis of first year of free.operatiSn. * / 

• Cooper-DeWath time study to determine distributidn'-^sJ^'offline and online 
time is carried out 'for ACR. • • ' " ' ; 

^ An additional day.(^4raining is provided to librarians. 

• Project is expanded to four npn-^ librffifies in other parts of the country 
using nonsubsidized search. • ,^ 
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SeRtember 1975 -December 1975 (Fifth Quarterly Report) ^ • ^ / 

• Oversight Committee meejts and recomjnends that two terminals be subsidized 
for a third year of full-cost search operation, as requested by CIN libraries. 
However, the Committee expresses concern that continued external funding 
wiil delay a full assessment of nonsubsidized online searcff in the public 
library. ' ' \ - ' 

• Search activity increases from 115 last quarter to 187 searches this, quarter ' 
(September, October, November). . . , - , 

• Newspaper advertisements produce little public response • ' , 

• An intensive mailing is sent to a community having a ^arge number of 
professionals. 

January - March 1976 (Sixth Quarterly Report) • • • / 



The number of searches shows a sharp incre9.se for this quarter,' from a 

total of 187 in the previous quarter to 254. . - 

Dr. Ahlgren of ACR visits the non-CIN libraries and reported on their 

chai^acteristics. * ^ f 

ThjS search- volume for the unsubsidized libraries proved to be extremely* low. 

The response to the CEST mailing to a conununity With a large number of 

professionals proves to be quite low. * ^1 • ' 

A detailed review of searches is m^e by Lockheed during this .quarter to 

dete'rmine common search errors. ' ^ - 



June 1976 



Oversight Gominittee meets to review draft of Two- Year- Report; recommends 

that third year of the study be devoted to providing ''a conceptual framework 

and to the evaluation of full-cost of online search to patron. * ^ . K 



Redwood City Public Library decides to'discontinue participation due to 
budget limitations. (See statement of Lisa Naef, Appendix B.) 
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September 1976 • . . ' * 

• National Science Fouhdatioi5^pproves a time extension for a third year of . 
Jhe study in accordance witli|the Overjsight Conunittee recommendations. 
Two-Year interim Report is issued. * 

After several months of. participation in* the third ypar, the Santa Clara 
County Library (Cupertino) decides to discontinue participation (see reasons 
given in^ the statement, of Barb*ara Campbell, Santa Clara County Librarian, 
Appendix B) , ^ • - • 

Tulsa City-County Library is given demonstration time and training'. 



V 



June 1977 



At the conclusion of fhe DIALIB study, San Jo;^ and San Mateo County 

is 

libraries decide to retain online search using a fee-for-service approach. 
The Minneapolis (INFORM), Cleveland (Facts for a Fee), and Tulsa City- 
County^pTPO n)-public libraries also continued their fee-based approach [ 
to online service, s . • 



* « 
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Section 2 ■ • . 

Inline reference retrieval 

0 

^This section provides some background on, online reference retrieval. ^ The fee 
structure ^sed in the DIALIB study, and the effect of fees on search volume are 
also*indicated> 



2.1 DIALOG®RETRIEVA^||pSTEM 

The Lockheed DIALOG Biformation Retrieval Service was used in the study. Approxi- 
mately 18 data bases were available at the Start of the Project. By the end of second 
year, over 36 data bases in science and technology, business social science, and 
psychology were available, as showi^in Fig. 2-1. (Note that the cost of eachidata base 
is also indicated.). By the end of the'<4iiird year, over 60 data bases were available. 
An annotated search, indicating the sequence of operations used, is given in Fig. 2-2, it 
and the DIALOG system is described in Appendix F. Although the DIALOG service was 
used, the results of the study should be applicable for public libraries using an online 
search service^hat is accessible via telephone lines using standard terminals, and 
offering a variety of data bases of general public interest. ' . ^ 

^ A* ' » 

To perform a search, the use#dials the telephone number of the search service and' 
obtains a high-pitched tone indicating that the computer is available. The telephone ' 
handset is then inserted into the acoustic coupler which is p^ of the terminal. A 
message revesting the user password is printed out on the terminal* Afterlflie pass-- 
word is accepted, the user specifies the desired data base and then enters se^ch 
terms via the keyboard. Search terms can be natiilral l^^age (English) or numerical^ • ^ 
'codes. j(such.as product, event, 6r concept class codes) for some of the data bases. 
The user is aided in selection of search terms by being able to have terms displayed 
that are^alphabetically close to an entered term'V (For some data bases, ternls that 
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LOCKHEED INFORMATION SYSTEMS 

DJALOG®' INFORMATION RETRIEVAL service/ ' • 
Worldwide Access to Worldwide Knowledge 

■ OVE^^ U MILLION CONTINUOUSLY AVAILABLE REFERENCES FROM WORLD'S PRINCIPAL OAI'A BASES ■ 



SCIENa V 

BIOSIS PREVIEWS iS^b/hr) - Worldwide coveroge of the life 
» sciences (19^ Jo presenf). 

• C\ COnD^P^TES ($45/h^^ -"fiibliogrophic dofo ond keywords 
for chemisfry'yikchemlcol engineering from Chemicol Absfrocfs 
Service (CAS7 (l%[2 \o presenf). 

CA SUBJECT IIjDW ALErI ($60Ar) - Subjecf index heodings 
Old CAS Registry N^nber? for CAS document (1973 \o presenJ). 

CA CHEMICAL NAME DICTIONARY ($60/hf) -»CAS Registry 
Number?, CA Index Nomcs, or^ moleculor formuloj for CASIA^^ 

CAIN ($2Vti?) — V/Orldwide coveroge of ogriculture from rhe J 

COMPREHENSIVE DISSERTATION ABSTRAOS (S55/hr) - Doc- 
torol cJissertotions from occredited universities (rrosHy U.Sv) 
(>86J »o present). 

SCISE-ARCH® ($70/hr)- Index to the lite^roture of science ond 
technology from th« Institute for Scientific Informotioo (1974 
to present). * 



Notionol Agriculturol Librory (T970 to present). 



SOCIAL SCIENCES ' ^ , *' 

• AlM^ARM ($25/HO - Abstrocts of Instructioool ood ^scQrc'*^ 
* motcriots (1967 to\)'*sonO^ . ^ * ^ 

ERIC ($25Ar) - Ccjmplctc doto bose of cdycotlonol mottno from 
the Educotionol Rif^oorces In/ormotion Center (1966 . "^esent). 

• EXCEPTIONAL CHILD EDUCATION.AB^TMCTS (S?5/nr) - LItero-\ 
tUre of educotion of hondi copped ond gifteePchildrer H'^'^o 'o 
present). ^ * » ^ ^ 

LAliJGUAGE AND LANGUAGE.BEHAVIOR ABSTRACT^ S'^j/hr) - 
Coveroge^^of speech ond ionguoge pot^logyJ196S to picenrl. 

• PSYCHOLC^tCAL ABSTRACTS ($50/hr)- Ll^eroture n , K-i t. 
ond other behoviorol sciences (1967 to present). 

• SOCIAL^CISEARCh'*^ ($70Ar)-Multid.scipl nor. 

the* soctol iciences (1972 to present). . ^ 

SOCIOLOGICAL ABSTRACTS ($55/br) - In-depth cover ^-.e of 
sociology ond rclotcd oreos (1963 to present). 



TECHNOLOGY/ENGINEERING 

CLAIMS' VCHEM ($150/br) - U.S , chemicol ond chemi colly , 
reloted potents plus some foreign equivolents (1950 to present). 

' CLAIMS'VGEM ($90/hr)- U..S. generol , electrlcol ,*ond 
mechonicol potents (1975 to present). 

• COMPENDEX ($65Ar)- Worldwide coveroge of engineermg 
litero>xjre from Engineering. Index, Inc. (1972 'to present). 

• INSPEC-^YSICS ($45/hr) - Worldwide coveroge of physics from 
the Institution of El^ctricol Engineers (JEE) (1969 tapresent)t 

• INSPEC-ELEC/COMP ($45Ar)- Electncol engin^ring, computer 
science, ond control engineering from lEE (1969 to present). 

ISMEC ($45/hr)- Coveroge of mechonicol engineering ond engi- 
neering monogement (1973 to present). 

METADEXj$80/hr) -Coveroge of metollurgicol literature includ- 
ing Metols Abstrocts Index ond AlloysJndex (1966 to present). 

METEOROLOGICAL ABSTRACTS ($50/hr) - Worldwide mctcoro- 
logicot ond^eoostrophysicol literature (197^ to present),'^ 

• NTIS^($35/hrJ - Complete Government Reports Announcements 
doto twse Covering government reseorch from over 240 ogencies 
(1964 to present). ^ 

OCEANIC ABSTRACT$'^($5Vhr) - Coveroge of worldwide ocoan- 
ogfophy ond morine -reloted literoture (1964 to present). J 

WORLD ALUMINUM ABSTRACTS ($50/hr) - Coveroge of lechnt- 
Col literoture ronging from ore processing to end use (1968 to^ 
present). 



BUSINESS/ECONOMICS 

• ABI/INFORM ($65/hr) - Coveroge of business, finonce, on^^ e- 
lot*ed fields (1971 to presenf). 

CHEMICAL INDUSTRY NOTES (S90/hr) - Coveroge of the . yni- 
^ coi^ocess industries from Predicosts, Inc. , ond CAS (1973 *• 
^prejp.t)-: ' ^ 

(Foundation directory ($60/hr) - Descriptio(«s of over jOO 
foundotions from the Foundotion Center (momtoined on curr<, 
bosis)j ^ 

FOUNDATION Grants index ($60/hr)- Cumulot.on of g. »r»s 
records from U.S* philonthropic foundotions (1973 to prese' « ^ 

• PTS DOMESTIC STATISTICS ($90/hr) - Time series'ond force cn 
U!S. economics, demogrophics, finonce, ond production (Ir ^ ro , 
present). 

• PTS EIS PLA'NTS ($90/ hr) - Doto on<rclos$ificonon orinau»r.jol 
" plonts in the U.S^ (momtoined on current bosis). 

• PTS F&S INDEXES (S90/hr) - Cititions to orticies relevont to busi- 
ness reseorch (1972 to present). V " 

• PTS INTER NATlONlU-SJJWWSTIC^^90/hr) -Time series one * 
forecasts on formqn economics, demOC(rophics, fmonce, ond 
production (I972\a present). 

' • PTS MARKET ABSTRACTS (S90A0 - WorldwWe coverog* of Cl-'«m- 
icol Mork^t Abstrocts ond Equipment Mork^t Abstrocts (1972 to 
present). ^ 

• , PTS WEEKLY (J90/hr) - Current Ond extensive coveroge pf 
chemical oTid equipment market information, reloted to Market 
Abstrocts File ('1972 to^present). 



\ 



Indicates data bases available at inception of study, June 1974. 



Fi^. 2-1 DIALOG Data Bases, (by End of Second Year)' 
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PERFOJIMING A DIAJjOGvSEARCH 




ERIC 



The patiron is interested m references to harmful food additives > and thfe librarian* \ 
'therefore chooses th6 National Agricultural Library 'Data Base that has a Food and 
Nutrition file. "The set or references pertinent' to the term "food additives" is fi^st - - 
selected. (T^ere are 217 suqh citations.) Then sets pertinent to the terms "harmluf; " 
' "dangerous," and "deleterious" are selected. (Sets 2, 3, and 4, respectively.) 
Finally fhe librarian combines the sets by ANDing Set 1 with the set formed by ORing 
Sets 2, 3, and 4. The resulting Set 5 has 13 citations, and to see which otthe mem- 
bers of this set are relevant to the request, the. librarian requests that titles* of the . ' 
fir^t three citations De.>type<f out. Because the third citation seems to be»of most in- 
terest to the.p'atron, the librarian requests the more complete citation for this title. 
Further information could have been obtained by requesting the abstract for that title. 

" Wlien many 'citations ai^e to be printed, the libt'arfan will request that the^jitations^be. 

printed offline and be mailed to the library. Note that the entire cost of this terminal 
^ session was pnly $1.08. * ' • * ^ . 

' * 4 * 

' ' '? BEGIN 10 ^ ^ • 

• . ' 2Pfluo77 Ilip2il6 l/ser9 70I 

$U.0o 0.003 Hrs UlelO 

. ^ ' FIlelOiAGHICOLA 76-77/JULY ■ ' - * 

Set Items Uescriptlon (+=a)Rt*aANDi-aN()r) 

, ^? SELECl F(K)D'AODiriVEb 

I ^7 h(XJD ADDITIvfeS 
? .SELECT HARMFUL 

34b HAPMrUL 
? SFLFCT pANGEHOUS 

3 ^00 JANGFRoUb ^-^^ . ^ . 
? SfLECl DELBTERroUS 

4 28 OELEif-RIoUS 
? COMBINE I AND (2 Ott 3 Ott 4) ' . ^ . 

5 13 I^AND (2 Ott 3 OR 4) - • ^ 
? TfPE b/6/1-3 ^ - ' ; ^ 

1148126 ' , . ^ 

HD9000.UF64, ID "NO.- /6-9440303 * * ' * ' - 

Openly confronting public anxieties over food safety 4 
• ' — — • 

* • 2 . 

HO 1 207 ' '* 

470 SCI2 ID NO.- 76-9431333 

Coloj- artditivesi botched experiment leads to banning of red dye no. 

I066ab2 

TP455.F65 1974 F&N Kf ID NO.- 75-9428341 
, ^ Food additivesi beneficial or deleterious (Audiotape) 

? T/PE 5K2/3 
* ' 3 

I0<i6db2^ 

1P455.F65 l974,>-JiN AV, ID NO.7 75-942634 1^ 
•jj- Food addltfvesi beneficial o'x deleterious (Audiotape) 

AAAS Symposium on rood Additives, San Francisco,, *I974 session It 
^ Anertcan A5Soc4at/on«f<^ the Advancement of Science ' . 

Wa^hin^ton , 2 audicTt^pes in cassette. 4s. 60 nln." 1974 ^ ^ 
CESCttlPTORS- Hood Adal tivHS, rlavor. Research, Fortification . ' 

' * • ' / . ' . * 

? Logoff ^ * • » . 

4' • 29auoV/ M i04r49 User9/0I * ^ ^ ,» * 

sl.oa 0.043'Hrs FU'elO ^ Descriptors ' " * . 

LOGOFF Mi04ib3 . . . 

^ f^%%^ 2-2 Typical DIALOG Search \ " V . - 

2-3 . ♦ 

' * ■ "35 - • • . . - 

LOCKHEED PALO ALTO RESEARtH LABORATORY 

^ I O C IC M I I 0' ^ ( $ J I H $ •« sf ACt COMPANY. 1 N C 

^. • * SUisioiAIY O^ lOCKHIlO^AIlCl^M COirOIAtNON 




/ 



LMSi 



are conceptually close to an entered term can be displayed.) The system fhen indicates" ' 
the number of document citations 1^ the data .base that contain the specified term(s), 
and supplies an identification number for this set of citations. Sets can then be com- 
bined using the AM), OR, NOT operators'. Because of the command language used, 
^and because knowledge of the data bases is required, a search intermediary who has 
been trained to use the system usually performs the actual search. 



2.2 SEARCH «FEES \ • 

As indicated previousl^the participating libraries chose to pass the cost of searching 

on to the patron during the second year pay period. We will not discuss the pros and 

cons of fee for service in the public library; the interested reader is referred to Ref . 3, 

and the'^comments of .the librarians in Xppendix B.* For an analysis of the co^t of online 

♦ * 
searching, see Section 3 of the An6ex volume, andR^f . 4. 

2.2.1 Fee Structu3:e " * * ' . • 



There is no fixed monthly cost associated with subscribing to the DIALOG system. 
Instead, search cost is computed on the basis of * 'connect time, '^the actual clock 
time that the user is connected to the systein. ^ This connect tinle^cost varies frqjn d^ta 
base to data base, ,as was Indicated in Fig. 1-2. ^ ' . " 



Because they were concerned about the cost of search to the patron, the participating , 
librarians requested that an alternative fee structure ie provided for the experiment ^ 
a structure that did not dependj on connect time. ^JTherefore, two different fee structures 
were offered to the participants, a ''custom searcli'**that had no limitations ,*and whigh 
was based on one-half the Usual connect time .costs, and a speci^i ''standard search" • , 
at. a flat fee Qf $5 per search thafwas limited to* a single data base and to 20 offline 
prints. Figure 2-3^shows a flyer that explained*these two types of search to the public^ , 
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COflPinWnO INFORfUTION RETRIEVAL 

DOES ym REFEReJfcE QuEsncy hequjue more 

THAN A STAWPARl), MANUAL LIBRARY SEARCH ? . • 

Perhaps a computerized search win find what you are looking for In the field 
of education, agriculture, psychology, science, engineering, or business. 

=* ' . 

For your convenience, the following platis are availalile: 



1. 



Standard Search 
A search will be conducted in one data base 



2. 



uaua uaac. There is a limits of 
ten sets^and'26 printed'cUations. It is sii^ge^ed'that it be ysed 
to search a limited subject or to search a subject on a preliminary 
basis, ^ior ;t(K§etting up a custom search , ' 

, Cost: $5/00 - 
C ustom Search 

This search can be as extensive as necessary to fully examine the 



material available on the subject 
Cost: A $5.00 deposit is required for ay 

_ payable on'comp' 

line pri^its are picked up. 



> cu^om searches, and the 

balance is payable on^conipletlon of the seapch,y|h at the time the off- 



This system will compile a sizable 
bibliography for you if the subject' 
is currently of great interest or 
if it has been heavily researched. 



If your particular subject is 
rare* or unexplored,. th,e compute^r 
may seek in vain. Perhaps it^.* 
* " citati( 



will not call 




up a single 
Not enough 



on. 




PleoA't xan^bzx, ii voe, ^eo/ich and ^ind nothing. .thoAt l& itUl a c/to^e. • 
li you .ch06t a'autom 6WLch, it mighi be co6tty.' So ptea&e,, iox youx 
budapt^i 6akt, and ovJi ptade, o<' mind, dl&au^ youK ptoiA fixttfi tht liMaAJjxn 
b€^z CJV4 6taKch U InJUUntdi. Then pe^fiapA, toe'^ aJUL cjoimaniaitt happlty 
ioKtvtCaitVL. • • ^ , ' 

See Aamp£e on ctthvi hidt, ' , J - ' 

Brought to you by: Cooperative Information Network 
Lockheed Information Systems and the National Science Foundation 



Fig. 2-3 Flyer E3q)lainirig Fee Search to Patron 
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Contrary to our e^ectations, the standard search was used only a small fraction of 
the time.* Two possible factors that^led to this light use were (1) tb^ ability of 
performing a custom search in the low cost data bases such as ERIC at less than $5, 
and (2) the restrictioi^^ to a single data base was found to be too confining. ; 



2.2.2 Mechanics of Fee Collection 

Feaxs ^Qve expressed that the libraries-would encoimter much difficulty in fee 
collection, both because of refusal of a patron to pay the balance of the fee due to 
dissatisfaction with the results, as well as by patrons who fail to pick up their Results 
their results and to pay the balance due. For this reason, a contract-like form was 
prepared and used, as shown in Fig. 2,-4. In addition, a procedure was established 
SG that a disgruntled patron could obtain a refund if the search was forwa^rded to 
Lockheed for analysis, and it was foimd»that the search had indeed been incorrectly 
.performed. (The library would refund the money to the patron and Lockheed would 
J credit the library *s accoimt for that amouht.) - 

^ - - . , • > . 

In actuality, there wexe no requests for„refunds and no defaults by the patron. It 
surprised the librarians to h^ve some of the patrons indicate that they thought that 
the search would cost even more. (See Appendix Q for some librarian comments 
concerning fees and the collection.) Ncfne bf;.the libraries used bank credit card 
operation, but several established accounts for several repeat users. • 



2. ^ 



^ IMPACT of' FEE ON SEARCH VOLUME . 



The impact of fee for service on search volume is shown in Fig. 2-5. Note that the 
, search volume rose during the free period from 55 searches in September 1974 to 
approximately 300 in May 1975, for the four CIN libraries. In June, 1975, when fee. 



*Oniy 14% of the searches wefe standard searches. 
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SAN JOSE, PUBLIC LIBRARY 
DIALOG SEARCH AGREEMENT 



DIALOG maktts it possible to search ^ larga number of documents, periodical 
articIaSt and. reaearch reports and compile a bibliography on a concise subject. 
DIALOG is not designed to provide answers to specific qucs^tions. The results 
of a saarch are largely dependent on the ^conciseness of the 'definition of 
subjact matter desired and the keywords or phrases chosen by the patron to^ 
describe^ it. 



Two types of DIALOG searches are available: 



STAHDARD SEARCH 
, Coat: 

Conditions: 



CUSTOM SEARCH 
Cost: 



$5^00 prepaid; 

Search will be conducted in one data base. 

A limit of ten sets can be formed,^ ^ 

A limit of twenty citations can be printed on-line. 

Additional off-line citations can be, printed "at 

five cents per citation. 



$5.00 deposit must be paijjrjjn -all custom seardtes. 
The balance is payable on-<oropletion of the search 
or' at the time the off-line print's are picked up, 
'The charge will be fifty ^percent of DIALOG'S 
commercial rate 

Conditions; Search can be extensive as necessary to fully search 
' the subject. 




I have conferred with a librarian and disctissed search terms and strategy. I * 
understand that a cost will be incurred whether the search is successful or 
not 'and agree to compensate the Libracy for such costs. I have read the 
••DIALOG Search Agreement" and request .that the San Jose Public Library perfoi^ia 
a _se^di. ' • 



Date: 



Signat\ire 



Standard Search 
Off-line Print s ^ ' 
Custom On-Line Cost 
Custom Search Tota»l 
Custom Search Deposit 
Staff and Conneot Time 
Balance Due 



AMOUNT 



DATE 



RECEIPT # 



n/c 



Search Number 



Librarian 



(Please make check payable to the San >Jose Public Library) 



Fig. 2-4 Typical Fee for Search A"g?reeinent 
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Fig. 2-5 Total Monthly Searchers Performed by CIN Libraries 
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for service- was-initiated, the search volume dropped precipitously to 29 searches, 
but rose during the year until 77 searches were performed in May 1976. It shoirid be" 
noted that there was considerable variation among the libraries. As indicated in 
Section 3, San Jose displayed a fairly stable search volume across all 3 years, while 
San Mateo experienced a significant dropdn search volume with the imposition of 
search charge^^ The online search activity for fhe entire 3-year period for San Jose 
and San Mate<|Co%ty is given in Fig. 2-6.. Note the variation in demand from month 
fto-month, a situatioc[^that-l^^ 
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2-6 Online Search»Tiirie for San Jose Public and San Mateo County Libtaries 
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'x - ; * * ' , Section 3 • ^ ' \ 

- ' ' , EVALUATION summary'' * * ^ 

• ■ . ■■■ .• ' • ' ' . 

One pf the principal purposes of the evaluation conducted by Applied Communication 
* Research was' to provide public library administrators with data which would allow 
them to make decisions about the utility of providing an online search service thrpugh 
the public library and to determine what the cost of such a service would be. To 
accomplish this purpose, case studies were completed for each of the four CIN 
libraries for the first 2 years. These studies were continued into the third year for 
the two remaining CIN libraries. (The non-CIN libfaTies participated for 6-51 onth 
periods to supply subjective evaluations; these libraries are discussed in the Ev£^lua^\ 
. tion Annex of the Two-Year Interim Report, Ref . 2, and comments from these .libraries 
- appear in Appendix B of the present report.) ♦ ^ 



Data for the case studies were collected through four major instruments: ^gmputer 
command summary ^sheets; search- request forms completed by both the' patron at^the 
time of the search request and by the librarian upon'qomplejiion of the.seaj;ch; follow- 
up questioimaires completed by patrons aft^r, receipt of the results of the search; and 
Interviews with working librarians, head reference librarians, and library 
adijiinistraitors. • ' • * ' » . • • ; 

The evaluation .was aimed along three major dimensions: descriptive analysis of , 1 
actual searches; analysis of usage patterns and.user characteristics; and analysis .b/ 
library impact. Search statistics included inforination on search costs, staff time • 
devoted to online searching, location of source documents, and time to cbmp^etetflie 
search. Usage patterns and user characteristics included information on user occu- 
pations, reasons for search, Jevel of education, '.type of question,* value of search to 
pafronty number of useful citations, and source through which patron heard about the 
availability of the online service. Library impact analysis included an assessment of 
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the impact of an online service on the reference service, the reference librarian, , « 
library policy, .and the conununity served by the library. Changes whidh occurred 
within each evaluation dimension between the free and pay peiyiods were als5 identified 
andd^ussed. 

The follo^ving evaluation material only highlights some of the data collected during the * 
course of the 'evaluation. For n^ore complete information, the reader is referred to N 
the Evaluation Annex volume, and for a very complete discussion of the methodology 
of reference service evaluation, Ref. 5 should be consulted. 



3. 1 CHANGES IN THE ENVTROICVIjfNT 

r 

It IS important to point out that the'DIALIB experiment was carried out in a changing 
environment influenced l?y societal conditions, changes in online search services^ and 
changes in awareness of the, profession concerning online seajrch, ^ 

• So.cietal conditions . The: 3 years were 4 time of inflation during which local 
government was under^eat,pi:essure to keep the cost of government under 

' control. Public libraries had their budget§l4^her cut or^maintained at a 
constant level, and the i^ing cost of books and Serials, coupled with rising 
laBor dosts, made life difficult for library administrators. This economic 
factor is one reason for the enormous growth of library networks. 

• Changes in online search services . There has been a large growth in the 
' ^' number of data bases offered by the search services in the past 3 years f 

^ • This growth resulte^^n a greater subject breadth in online retrieval, and 
, hasf^en a move to more humanities and^ocial sciences offerings: There 
^ have been .cost reductions brought aSout by decreased communications cost^, 
as well as competition between services. ' The system reliability for both . 

communications and search service'has improved, and training copses and 

' ^^^^^^ 

materials offered by both the search services and the data base purveyors 
have also improved considerably during this time. ' 
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• Awareness of^the profession . When the project began, there ^yas little in the 
way of "books, journals, and^papers Concerning online search. This has now 
changed, and there are now Wo journals devoted to online search. In addition, 
the Special Libraries Association and the American Library Association 
offered seminars and discussion sessions on. the technical aspects of online 
search, as well as on t}\e philosophical questions (such asTfee for service) 
that often arise in coniaection with online search, * • 

Within public libraries, there was increased use of networking and increasing 
automation of routine library functiong. There was increased staff awareness of 
online searching. There was also increased demjand for 'developing jiew means for - 
meeting the information needs of the public, ^ ' ' 



In short, the ^environment within which the DIALIB project took place was far frc 
static. ' • ^ , 

3.2 RESULTS OF THE STUDY ' . ^ 

r 

t • ' 

• \ 

When the experiment is viewed acf^oss all 3 years, a number of trends appear: ' ' 

• The personalities and commitment of. individual librarians continued to be * 
. *a key factor in the success of onlirie search' in the public library. * 

• Staff time continued to be perceived as the major problem by the participating 
libraries througjiout the study. i 

• Searchers tended to use only a narrow subset of the available data bases to * ' 
answer client questions. ^ ^'^ ' • 

• Search costs did not appear to be a problem to the patrons. Although there 
Vas a significant drop in the nunpiber of searches conducted when the initial 
charge peripd begain (in Year 2), the movement from half- to full-pay mode 
(at the beginning of Year 3) did not significantly impact' the search volume. * 
There were significant shifts in the kinds of people whq used the service 
across the 3 yqars of the experiment. / / ^ ^ 
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• the value of a search to the patron remained hi^ in going from free, to , 
one-half fee, to full fee. * . . * t 

• The patron was present more often in the second and third years (50% of .the 
" searches), compared to the first year (15%). • ' . j. ' 

• As the libraries became more experienced in online searching, .their time • 
A • ; perfo^naance appeared to become more uniform. 

• ♦ * 

These trends are discussed in more detail bel^. ' - , ' 

- * . * » ^ 

3.2.1 Importance of Eidividual Librarians . ' 

The major trend across the 3 years of the project is the impact of individual personal- 

9 

iti^s upon the success of the search service in public libraries ^ During the coui^se 6f 
the project, we observed the impact of personalities at all participating libraries and 
at some non-CIN libraries as well. Although it is difficult to supp'ort with data, we 
feel the personalities and commitment of individual librarians are the ke^ factor to the 
success of online ^e arching in. the public library. In essence, what^s needj^ is an 
entrepreneur — somebody within the library staff who becomes a strong advocate of the 
service sndi/Q williij^ to promote it 6oth within the library; •and to tHe usef^onununity. 

Three specific. j;ptes determine the 3ucoes^of online searching ip public libraries: 
the searcher, the he'ad reference" librarikn, arid the library director.- 

The searcher is responsible for the actual interface between the /client' and the seardh 
service. Two basic types of skills are required — query negotiation and online searoh- 
ing. Query negotiation is common to all reference work and online search ^skills ^tre, 
to a certain extent, extensions of traditional library search skills. Some people are 
muth Aore adept at online searching than are others, but in general it is a skill which 
can be learned^. We feel the skills and personality required for the searcher can be 
found in most refe^^ence departments; all that is required is training in the use of the 
online, search service and in the use gf specific data bases. % 
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Although the qualities required for online ^earchini^re ^ot particularly difficult to 
fill, the qualities requirelH of the head reference libmrian and the library director 
are rare and difficult to find. These rolei^ require a strong personal commitment to 
.the service and a sense of entrepreneurship. Without the strong support and commit- 
ment of both, the head yference librarian and the library director, th^e potential for the 
success of online searching i» tlie public library is at best marginal^ 

• 3.1 2 Staff Time 

All four CIN libraries perceived staff 4ime as their major i)roblem/ Paf-ticularly 
during the free periq^, all the libraries found themselves* hard-pressed to handle the 
demand for, staff time generated by requests for online search. In the transition from 
free to pay service," the librarians decreased their average online search time" from 
_J3 niinutes to 16 miliutes. (This was partly due to increased familiarity with the 
DIALOG system, but a major factor was also the desire to keep the cost of the search 
to the patron as low as^fessible.) However, this time saving was offset by increased 
offline search preparation time which increased sharply between YearsJL apd 2,. and 
dropped slightly in the third year. • 

The distribution of average o01ine preparation time for the 3 years of DIALIB is'^^ 
shown in Fig. 3-1. The most dramatic change is in the searches not requiring prep- 
aration time: almost 50%, of the seareties.nsed no offline preparation time in the first 
year, while less than 20% of the searches required no preparation tinae in'the third 
year. 'On the other hand, while about 20% of the searches required 15 to 25 niinutes 

of offline preparation time in the first year; more tfian 40% of the sear,ches required ^ 

* « ' » « 

15.to 25 minutes- of preparation time in the third year.of full-fee service. 
.• . - ^s> 

An interesting comparison of the 'average staff time for^ search for the four CIN 
libraries is shown in'Pi*g. 3-2. These data were obtained in the first and second^ye^s 
of DIALIB. Note how, the imposition ot fee for service had little effect on the Sari^Jose 
and Santa Clara County libraries, but" caused an increase of about i/3 in going from 
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free to fee service at the San Mateo County Library, ajjd a doubling of preparation 
time for .Redwood City. . - " ' . 



3.2.3 Data Base Use ' - 

' ' *: ^ ' * . • '\ v«*, ^- 

During the course of the interviews, most libraries noted that they had little d^i^and 

for most of the available'^d^ta bases. Their comn^^ts indica^te that, for the most. part, 

•data base use accurately Reflects the inter ests.pXttie clients, and is not influenced bv 

data base cost. " * ' - 

Looking across all 3^^rs of the proje^ct, there was a significant movement toward 
the use of only a few data bases. The use of both ERIC and Psycholo^caljibstracts^ 
increased steadily across all 3 years of the project, as shown in Fig:^3-3.' 

Year 1 Year 2 . Year 3 

V. . . l?o. % -No. . %. No. - %\ 

ERIC • 344 .(15.5) 232 (24.7) 146 ,(31.6) ' 

Psychological Abstract ' 357 (16.0) ^ 180 (19.2) 95 (20.6) " - 

, '31.5 43.9 ' '52^2 . • 

In the^hird year of the project," these two data bases -were used foe more than 50% of 
th^ searching. ^ Data bases which showed decreasing. use included NTIS, Sgcial Science 
Citations, Engineering Index, INSPEC, and' Chemickl Abstracts. . 

Interviews with the librarians reveai^ed that thev were aware^that they were usjtag only 
a few of the available data bases. ^ All librarians indicated that they felt most com- 
fortable with the frequently used data bases and thisy acknowledged that significantly 
more preparation time was needed to search the infrequently used data bases. 
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There are several possible causes for this increasing reliance on only a few data 
base.s: \ 

' : ^ / (1) These are the data b^ses the librarians felt most comfortable with, and 
' , therefore tended to use to answer most questions, • 

jllC^2) The search topics dealt with areas that were covered only by these data 

%T'^'i\, bases. 



?V^- \ (3) The search topics reflect the fact t^t the seiyice attracted only a par-* 
ticular type of client w^^se.- seaijdlTrequests'de&lt with the areas covered < 
by these data base^s?^^^^ 



"It should be noted that, although this reliance on only a<^ew data bases parallel the 
reailts obtained in the ACR study of METRO-ColumJbif Teacher s,College, it is quite 
different from the experience reported to ACR by Minneapolis (INFORM) and Tulsa 
(INFO n) . ' ^ . > ♦ • ' 

3. 2* 4 Search C.osts 

It is difficult to compare search costs to the patron from the second to the, third year 
since during the second year patrons paid only 50% of the search costs arid also had - 
the optiOT of obtaining a "standard -search" for $5. (The standard search was of one^ 
"^iata base, with a maximum of 20 citations.) . However, by 'ignoring standard searches, 
and doubling the patron cost f^ the second year, we wei^e able to make this comparison. 
We found that the user search costs dropped slightly duflnglie third yea^ Below are 
listed the various search cost levels, percent of searches performed at each level dur- 
ing Year 2, projected Year^2 search distributions,^ and actual third year distributions. 



^Projected costs were obtained by assuming that the.^stribution of actual seai^K.c^^_ 
would remain the same, although in the third year patron§ wo.uld be charged, the fulV^'" 
cost of the searches. Thus, given that 25.9% of all searches in the second y#ar Cost 
0 to $4.99,. the actual cost Qf these searches ranged fyom 0 to $10. We assumed an 
even distribution so 13% of the searches should cost $0 to $4.99 and 13% should cojat^J 
$5 to $9. 99. The precision of the cost reporting prevented projections beyond the 
$19.99.l€5j;^l. ^ . . 
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• Percent of Searches 
n T 1 Year 2 • Year 2 

uost Level (At 1/2 Fee) CPi?oje?ted for Full Fee ) . ^^^"^ ^ 
• ■ < - ♦ - 

0-4.99 . 25.9 ' 13. ^ ftp.l v 

5-9.99 35.4 " * • • * 13 25.2 

10-14.99 10.5 17.7 ^ . 21.5 I 

' 15-19.99 ' 8.2 . 17.7 e - ' 12.9 

The distribution of costs to the patron in the third year is^shown in Fig. ,3-4. Note 
that 61^ of the patrons spent less than $15 for their search. 

It is .also interesting to note that the impositioif of full search charges did not result 
in any decrease in the number of searches performed. Both libraries showed to in- 
creaserin search volume over the previous year. San Jose displayed a fairly stable r 
search volume across all 3 years, while San Mateo experienced a* significant drop in 
search volume with the finposition of search charges., (Re^iember that little or no 
publicity was provided during the second and third years'.) » 

^ ^ . » l^umber of Searches . ' - ; 

1 , ' • , 

Year ' San Jose . San I^Iateo 

1 . 252 ^ • 198. 
'/^ ■ ' . ' ' 2 '226 . . 44 

" , - 3 242 62' 



3.2.5 Changes in Clien^^oups 




The principal users of the system were graduate- students,' educators, technical 
,j^rofessionals^ an^JiJbraf ^ans . [Previous analyses of public library psers, (Ref. 6) 
, give similar result^.} Most online searches wete requested as either part pf fhe 
patron's job or for research papers. ^ . * 
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There appeared to be significant 'shifts in user deSaographics across the 3 years of the 
project. Use by graduate students, education professionals, and business professionals 
increased steadily across all 3 years. ConVersely, use by technical professionals, ^ 
scientists, anS undergraduate students decreased steadily across all 3 years. Both 
trends appear to correlate .with observed changes, in data base use. ^ 

While we have no data to explain this shift, it could be in part" due to the imposition of 
search fees. Certainly charging for the service would tend to make clients carefully 
consider the utility of the search and, perhaps, to seek alternate solutions to their 
information problems. The proximity of San Jpse State University to the San Jose 
Public Library helps to explain the* large numbei* of graduate students. The drop-in 
use by technical professionals and scientists might in part be explained by the with- 
drawal of the Redwood City and Cupertino libraries, which were the libraries closest 

\ 

to scientific and technological users. An alternate explsLnation is that continued use. by ». 
a particular client group is' directly related to the degree to which that group is well 
serVed.By the libra|;:y, ^ . ^.s^ • ^ .... . , ^ . 

# 

- 4 ' \ ' ... 

3.2.6 Value of Search to Patron • 

.*The value of the search to the patron for the entire 3-yeai; period is shown in Fig. 3-5. 
It will be noted' tj;iat there was a slight increase in perceived valjae in going frpm free 
search to one-half 'cost search to full-fee search.. Some of the factol^that may be » 
operating are: * / ' ' ' . 

(1) The librarians became more proficient in use of 'the system - ^ 
X2) The shifts in user demographics mi^t be a factor 

(3) People sometimes express more appreciatioij of a product when they must . 

pay for it • • ' ... • 

* 

3.2.7 Increased Patron Presence, Decreased Time Impact 

Cooper and DeWath, Evaluation Annex, Appendix 2, , noted that the patron was present 
for the search much more frequently (50% of the time) during the pay period (Year 2) 
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than during the firSt-year free period (15%). They' suggested that this was perhaps 
due to the increasing confidence of the librarians'. i^Another reason, of course, Is that 
the patron can assist the searchei: in conducting the search, particularly in highly 
technical areas » ^ , * 



Data suggest that the»tinie impact of the patron's presence on the search was signifi- 
cantly less during the pay period. During the free period, searches conducted with 
the patron present required almost 50% more connect time than did tliose conducted 
^^^;;;|2^thout tha patron present.^ During the second year pay period, the increase in con- 
nect time due to leaving the patron present at the search was generally insignificant. 
This suggests ttiat' having the patroil present at' the search is no hindrance for the ex- 
perienced searcher. Tlfe librarians in th,e DIALIB project who preferred to have the 
user preseiit nqted that the user can often provide useful inform^tioiv during^ a search. 



3.2.8 Increased Inter-library Conformity 



As the libraries became more experienced in online searching, their time perform- 
ance appeared to stabilize. Cooper and l^eWath* noted significantly fewer differences 
between the libraries in Year 2 than in Year 1. Some differences in library style re- 
mained; however, the search processes appeared to become more uniform., The move 
from half -pay to full-pay generated very little (jhange in library operations. 



*See Appendix of Evaluation Anftex. 
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- ' * ' > Section 4^ * * 

' PLANJ^ING FOR ONLINE SEARCH SErViCE IN THE PUBLIC UBRARY 



One of the major goals of th^ DIALIB study was to develop guidelines that would be 
useful for public libraries contemplating online search service. ^"his section uses 
, n^aterial given in the Evaluation Annex to formulate/^uch guidelines. The key require- 
ments for online search service are first enumerated and discuss^. A check list of 

> i 

* questions that must be answered by a public library contenaiplating "online search ser- ^ 
vice concludes the section. A rec^ent publication by the American Library Association, 
Ref. 7, will also pro\%de search service planner's with useful guidelines. 

- 4.1 KEY REQUIREMENTS FOR ONLINE.SEARCH r 



We have identified 9 key requirements for online segirch in the public library:^ 



(1) ESlfliblish scope and limits of servic e. The online search service must be 

'<33r ' — " ^- ^ 

stnictured.by the goals and objectives of the library and the riee(^§^Mts patrons, 
and -not by the potential of online searching. . - * 




1^(2) Staff time . The impact of online search on staff time must be carefully 
ci^sidered. 

(3) ^Staff attitudes . Attitudes of library personnel toward the role. of reference 
^^services, and toward fee-baSed service (where applicable)' are crucial to the 
/ success of online service. • . - * . 

^^iM Funding A method of supporting the cost of online search service must be 

M /' ^ ' ■ 

I ' developed. • : . * ' . . • 

y 1 . ' ^ . . ^ ' ' ^ ' ^ 

'(5) Need for promotional planning . Methods of letting the public know about jthe 
' ' ' ' * 

existence and capabilities of the online search service must be developed. 

(6) ' Need foi- ingoing staff training . In addition to the initial tirajining, the librarians 

must have the time and budget to maintain^and iqaprove. their competence by. 

means of practice sessions, to critique searches among the staff, and advanced 

trammg sessions. 

\ 
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(7) l^eed for-a critical mass of searches ^ The staffing should be such that a librarian ^ 
/ can maintain a critical mass of- 5 to 10 searches per month per data base. 

(8) ^ Document supportr -To provide effective searching, the library must be prepared 

to invest in, and maintain, adequate support documentation. ^ 

(9) Management and evaluation . Some method of evaluating the impact of the service 
' on the library and on the community must be found. ' / 



These topics are discussed in more detail below. ' ' ' \ 

4.1.1 Establishing Scope and Lij^its of Service • ' - > 

The iirs^ key requirement for a public library offering onlini^searching is to define the 
scope and limits of service. Every' library has some set of i^iles to define scope and 
service. Some rules are explicit - such as requiring cards to check out bopks.*^ Other 
rules are implicit, for example, decisions as to ho^ jaiuch time to devote to a particular 
type of question, such as a phone question. In addition, the library can also limit ser- 
*vice without rules — by not^g^ng people aware of tli^service* 

In offering onHne searching, the library must invest significant effort. into establishing 
the scopd and limits of the service. Issues whicrh must be dealt with iaclude: . 

• What are the goals and. CSjectives of the service? * / . 

• Wiirthe service be used to support internal. oijeratione, to gfovide service^ . 
to "patrons, or both? ' . ' 

• ^ • What limits should l?e established in terms of subject areas, costs, staff 
time, etc. ? . * " ^ 



• ' Will user fees be used to limit service? 

• Who, will be allowed access to the service? 

• When will the .service be available? . 

• ^ What kind of service ^^dll be provided? 

• What level of publicity will be used? 
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These are major questions. Determining the -scope and limits of the service has 
major impact on other decisions which must be made* It is important that the service 
^ should bl: structured by the goals and objectives of the library and the needs of it^ 
patrons, not by the potential of online searching. ' ' 

4.1.2 Staff Time Requirement^ • / - i 



The. staff time requirements associated with the introduction'and provision of oiUine 
searching cannot be overemphasized. ^Throughout the DIALIB experiment, staff time 
was perceiyed by the libraries to be the major inhibiting factor. Searches average 
approximately 1 hour of staff ttme^ (for query negotiation, search preparation, search- 
ing, and post-search activities). In addition, time is required for promotion, account- 
ing, and training of search personnel. 

r 

V 

LiJbraries planning to introduce online searching must v^ry carefully consider the 
impact on. their staff. They must be prepared to add st^f to 'support the new service 
Qr to divei?t staff from other activities, if and when user demand develops. 

4.1.3 Staff Attitudes and Support \. * , 



Preconceptions ajid attitudes of library persbhnel toward fee-b^sed service, and the 
role of reference services, play a grea1;,part in defe'rmining the directi(^ and ulttmate 



^ " 3uccess A>f_online. searching. 



More specifically, we feel that the attitud^ and support of the head reference librarian 
andrS^ library director are crucial to*the success of online searching. Unless both 
are firmly conoimitted to work for aiyitzsupport onLto^ se^chftjg, the probability for suc- 
cess is at best marginal.* , ' ^ '\ 

o 

o 

•The attitudes and support of the reference librarians whg Vill serve as^searchers are 
also important. However their reactions toward online seafching in the public library 
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will be determined, to'-a4arge extent, by the activities and opinions of the head - 
• reference librarian and the library director. • - • 

In developing a plan for online searching, it is vital that emphasis be placed on 
establishing and maintaining the support of the libtfary sta^-from^&ei.administration,*- 
to the reference service to the circulation department. / '\ 

4.1.4 Funding * ^ ^ - . ' 

The financial requirements for online searching cah be divided irifco three cltegories? 

(1) Capital (startup) costs include initial training, initial purchase of a com- 
puter ternunal (if the terminal is purchased) , purchase of documentation, 

^ ' and initial training costs. . ^ ^ , -"^ 

(2) Marginal (or variable).costs'are those costs that can be associated with a 
specific search. They include retrieval service costs (based on terminal 
connect time ^nd printing charges), conmnJnication costs, and search- 
related staff time. * . ^ ' 

m ^ 

(3) Overhead charges are those charges that are specific to the online search 
service but cannot be associated with any specific seaj'ch. These may in^ 
elude terminal rental (if the terminal is leased), 'terminal maintenance, * 
staff fime for tr^inin^(and also search-related ^taff time if ^ot charged as 
a marginal cost), maintenance of documentati^; and 'maintenance of 
training. Errors 'ir]i searching can al^o be 'considered as an overhead-cost. 

Some^^pecific cost values will clarify jlie subsequent discussion. The CoopercDeWath . 
study, summarized in Appendix H, sfiows^an average cost of a search during the pay 
iJeriod as $26.44, including offline and online staff time -and search^service fcost (con-; 
nect time and printouts). If We assume 30 searches per month, we obtain the follow- 
ing costs: ' , ' »<. 



♦Terminal maintenance is included in the leasing cost. 
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(30 searches/month) ($26. 44 per search)^ 

(30 seSrches/montli) (1/4 hour connect time) ($8 per hoUr) 

» communication 
* , cost* 

Terminal cost per month, including maintenance ^ 
* • > ' p 

Total monthly cost^ 



$'800 
$ 60 

$ 125 

$1G00 (approx) 



If we assume an annual budget of $500 for staff training, $500 fbr reference materials, 
and $500 for publicity, we see that the annual cost of an online search sei^yice per- 
forming^O searches per month is .$13, §00. ' ^ ^ • 1 

A pubUc library has the option of either supporting this cost from the library budget 
or grants, and offering the service to the public at no dost;^ or. service can be offered 
at a fee that partially or completely covers the cost. If the service is supported t)y the 
library budget, then the library must develop policies which define alid limit the ser- 
vices provided. In' the free portion of the DIALIB project, the libraries did not place 
overt limits on the service. When they were confronted by rapidly increasing search 
request's: they opted for an implicit form of .control - cutting off all publicity about the 
service. The lack of specific policies ^d rules for the online search service had. a 

^ continued impact of the DIALIB project. This is an ar^ which should be of 'prime - 
concern regardless of whether ^e service is 'offere'd on a free or pay basis: the estab- 

^ lishment of the scope aft^ limits of .service, as discussed in subsection 4. 1. 1, Is 
strongly related to t^ funding question. v ^ 

4.1.5 Need for Promotional Planning ' • ' . ^ > 

^ ■ . ' . ■■ ;, ■ ^. " ■ .■ 

Promotional planning is an essential part of the development of- the ojiline- search 
service. Failu^rejy promote the service, will-keep it.from readhing its full potentjaf. 
Printed signs, brochures and public announcement can be effective. .However, demon- 
strations of online searches to potential, users has been.found^to be one of the most * 




♦Most major cities" in the U.S. have Tymnet or Telenet comiiiunications setvice to the 
-search services at $8/hour or less. 
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• effective ways of publicizing the capabilities of online searching. Small,* portable 
terminals are now available that allow off-site demonstrations to be given to school, /. 
community, and business groups. * , 



ERIC 



4.1*6 Need for On-Going Staff Training • • .•" 

The library must also invest irf ongoing searcher training on data bases. The^search 
services generscUy offer, 1- and 2-day training sessions in' the use of their systems, 
and training in the u^Se of specif ic, data baseij is generally offered by the'd^ta base^ • 
producers. ' . 

Lack of specific data base training w^s a. common complaint among librarians acposs 
all libraries and all 3 years of the project. obtaining specific .data base training, 
the library will confront three problems: 

(1) Availability of training . f^Sta base providers generally offer training- 
^'sessions only a fex^ times a year in various parts of the 'country ^ . . / 

(2) AvaiiaBility of "personnel . Sending librarians to training presents a staff 
cost expense to the library 

(3) Training costs . Many data, bade providers charge, for training sessions 
and. Unless the sessions are available locally^ trainin^may require travel 
and per diem costs. • , 

4.1.7 Need for a Critical Mass of Searches ' ' "t '* 

A -critical mass of searches is required to maintain searcher competence. Most 
librar^ans4nterviewed agreed that 5 to lO^searches per month were ilecessary to 
maintain search 'skills for each data base/ Certainly it is possible to conduct seayches 
on a less frequent jjasis; kowever, the librarians indicated that they felt under these 
circumstances they were less efficient: . , . 

Search competence- Is concernefd with specific data bases rather than general skills 
yequired*to deal with the search system. This suggests that rather than *have bne or / 
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two searchfers handling all'searches, it would be more effective Jx) train a num,i3er of 
' searchers, and have eacdi specialize in only a few 8ata bases. \ > ^ < 1: 

Centralized searching for a library network, or a library system with blranohes, is 
feasible. Data show little difference in client satisfaction with results when the search 
is negotiated at a branch rather than the^ searching library. The data also show, how- 
ever, that branch libraries in San Mateo County sent itf/ew searches. Thus, although 
maintenance of a centralized search facility may provide the necessary critical mass, 
carQiul attention mu^t be paid to training and wQrking'with branch librati^ria in order 
to have the branches forward questions to the search center.* Training ^ould include 
familiarity with the online search service, an awareness of available data bases, ^d 
que?y negotiation* ' . . " ' * , 

4.1.8 Document Support - ' , * 

To provide effective searching, the library must be prepared fgb invest in and maintain 
adequate support .documentation, such as 'Thesauri. Uocumentation is ^^(juired for tlie 
search services, and for each individual data base* Some of this documentation is 
available free of'charge; however, some must be purchased. Document cost for each 
data base used ranges from a low of $10 to-$15 to a high of over $100. 

There is a need for better data- base documentation, search service documentation, 
and summary documentation, and such documentation must be'periodically reyised ' , . 
and kept up-ta-?date. In particular, we need: . » * . . . 

' Brief data base guides, as well as detailed data base descriptions . 
• Guides that show similar search commands.in each major service * 

Documentation that compares data ba'Se characteristics along con^on " 
^ - dimensions, such a^^nguage, scope, or typtes of documents iripluded and 

" ^ excluded* - ' • , ^ . 

Tabulat and summary ^documentations and comparisons for at-terminal use 
' ♦ . . . 

» • ■ 



♦Ajppendix F briefly, describes the problem of resource sharing.' 

' ' ' » ' t 
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Some work has been done in this area (for example, by the National Federation of * 
Abstracting and^dexing Services, and by the American Soc.iety for Information 
Science),, but more is needed. •' ' 

4.1.9 Management and ^valuation 

Another area which libraries should explore carefully is management and evaluation, 
particularly in accounting for staff time.. It is essential that accurate data be collected 
, ^ allow the liby^rjr administrator^^o assess th^ ImpaytSof tJie s^jarch service - on 'the 
, public, and on the library. This requires the establishment and nij^tenaiice of de- 
tailed procedures for recording staff time and activities. ' . 
>. • • , - * 

If the service is to be offered on a fee basis, then additional procedures are required 
to govern the collection of funds. ^1 * • ^ 

If the service is offered via a* network, then it is important that a single, uniform 
system be developed to transmit requests to the searching library and to transmit ; 
* search results back to the requesting library or to the patron. 

Evaluation is extremely important. This includes evaluation of (1) Impact on the 
library,, (2) user impact, and (3) the quality of the searches produced. It is'essen- 
tiaUhM soihe procedure be- developed to collect user feedback to assist in the evalu- 
ation. Unfortunately, prbcedures for assessing the quality of searches are. still ad ho^. 
.in nature, and f es(iarch remains to be done in this area. * « , 

' 4-. 2 A CHECKLIST OF QUESTIONS ' 1 

• ' P ' ' ' 

From the. preceding discussion of requirements for online search in the pubUc/hbrary, 
we can derive the following checklist pf questions for usg as a planning guide: / 

f ^ 

(1) Shouljj we- offer online search servjjce? / ' * 

• What goal's will we attain by offerin^thi's service? 



• Do we have experieiiqe^iji indepth reference service? * t 
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Do we hav^ a potential user group? * 

Is- the staff positive toward offering such service?^ ^ 
Are the data bases offerred by the retrieval services pertinent to the needs 
of our patrons ? - ^^^^ ' ' ♦ 

Caii-we provide adequate funds for staff, search service costs, and terminal 

by either library budget or user fees or a combination, of both? 

If user fees. seem necessary for budget support, can the fees be persuasively 

I ' ' • ! . 

justified to flinders, to the library staff, |and ft) library jpatrons? 

(2) What level of service should we offer? 

• How -many x^eferenc^ librarian^ can we devote to this service? 

• Do we want to actively solicit users? 

t 

• What should our policy be for reqpests that come from outside of our service 
.area, e.g., out of district users, request from other libraries? 

• Should we offer. all available data bases or concentrate on just a limited 

•< • , . 

number? ' ' * 

(3) What about the- details of setting up the service? ... 

• Should we place the terminal in an open area or do we want this to be a "backi 
room" operation? *^ . ' 

. • , How many librarians should we trjain? 

• What reference aids do we want to purchase in support of the service? 

• What type of publicity should be used? ♦ 

• If a fee-for-service approach is t6 be used, what bookkeeping* and billing 
arrangements are to be used? 

(4) How can we control the activity? ' / 

• Do we want to prevent' individuals or comp^es from frequent use of our 
seryice, and if so, ho\v can this be done? . 

. • What reco^s do we want^to keep on search time and search activity? 
- m Do we wantTrb monitor user reaction tc^gur online service? 
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(5) How can we evaluate the effectiveness of the system? 

• What evaluation techniques. can we user to obtain user reactions? 

• Can we develop a means of comparing manual and online search activity? / 

• How can we evaluate the impact of onHne search service 'on the library? 

• How can we evaluate the. impact of online sea]?ch\;service on the conxinunity 
.of library users? * 
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Section 5 
CONCLUSIONS * • 

This section summarizes three general aspects of online search in the public library, 
(1) ,the market for such services, (2) the impact of online search on the library, and 
(3) the question of fee for service in the publ^ic library. * For further details on thefee 
topics, see Section of the valuation Annex. . . • 

5.1 THE MARKET 

Online searching has been expanding rapidly from a highly specialized service avail- 
able only to, or through, government Agencies, to a service that is available to 
hundreds of academic iibrai^ies and industrial users. Heretofore, however, it has 
not been available to the general public. Until the advent of DIALIB, only people 
, associated with large brganizations.had access to the scientific, technical, and ^ 
business-oriented data basep 'available thrpugh Lockheed, .and other vendors, 

. The DIALIB* experiment has shown *that there is a naarket for existing data bases. It 
made 'up of employees of small' businesses; of students from colleges and .universi- 
ties wlio do not otherwise have convenient access to online searching; of individuals 
who are starting qp a business, doing personal research or investigatioh; aad of local 
government^ officials. Other users of the service came from government agencies o^ 
" all sizes and descriptions, and small hi^-technology firms. These people appear to 
hs^ve a n,eed for access to online searching and may have no other point of access. ^ 
They have been vocal in their endorsement of th^ public library as a linking tdgent to 
' the data bases, and have been willing to pay for the use* of the service. 

* Unfortunately, it is not possible to estimate what usage of the ser^ce would be if the 
libraries were able or Mlling to engage in a piodest amount pfad^ertising.. The 
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service was publicized vigorously when the DIALIB experiment began, using ^i^on- 
strations, posters, brochures, newspaper stories, etc. Since the searches were 
free during the first year, demand soon began to tax the staff resour6es of the par- 
ticipating libraries. The publicity led to a demand that appeared to be greater than 
they could handle. Additionalpromotional efforts were halted.- Although the demand 
during the sedond and third years of the experiment was less than the libraries felt 
they could support, they were unwilling to authoirize further publicity. As a result, 
most users of the'^service during. the second and third years heard ai>out it throu^ 
word-ctf-mouth. ; ^ - 

We feel that the DIALIB project showed that the public library has the potential for 
serving as a linkage agent between the market and the online search services.* As 
indicated in section 5.2, provision of online search service through the public library 

or 

can be viewed as a natural extension of its current reference services, requiring many 
of the same skills currently used. However, the future of online searching in any par- 
ticular library will probably rest in large part on the .attitudes of the people providing 
the- service. 



5.2 bNLINE SEARCH AND THE PUBLIC LIBRARY ' . 

This subsection briefly indicates some aspects^f librarian training related to online 
search, and discusse^|j|^role of in-depth search in thejpublic library^ Some change^ 
to be expected in a piiblicJibrary offering such service are also noted. 



5.2.1 Connection Between, Manual and Online Search Skills 

The traditionally .trained public librarian Boes have a variety of skills that are directly 
applicable to the kinds of ^skills required in online searching. These include the ability 
to form an adequate /search query by consulting with the user and encouraging the ' 



*Other possible linkage agents are college and university libraries, and private 
information brokers. See Evaliiatjion Annex, Sections. ^ 



7r- 



•5-2 

.LOCKHEED PALO ALTO RESEARCH LABORAT^Ys 

lOCKHIlO MiSSil SfACI COMPANY INC 

A SUtSiOl^tv' Of UOCKHMO AIICKA^T .COKfOIATKTX 



'LMSC-D560986 



user to communiqate his needs fully. The traditionally tr^ed reference librarian 
is already emert with complex manual tools ~ thesauri, indices, etc . , — and the 
skills developed with, these tool §^re transferable to computer 4,ata base searching. 
There is considerable evidence that traditional reference. librarians are willing and 
able to learn data base searct techniques. ^ ' ' * 

5.2.2 Librarian Skills and Training 

Many librarians involved in DIALXB^became skilled online; searchers although most 
would agree with one oithe conclusions from the Interim Report^that to maintain 
search proficiency, .online searchers must complete some 'critical mass' of 
searches each month in each data base for which proficienQy is desired; the large 
number of different data bases makes it difficult for an individual to maintain a thor- 
ough knowledge of each data base. ..." 

» 

There appear tabe two problems — training on specific data bases and subject skills. 

Many DIALIB searchers complained about tfe^ack of training on specific data bases 

and emph^asized'the need for such' training.. Each data base is unique; it has its o^J^ 

organization, thesaurus, and idiosyricracies*- While it; is possible to search the data 

base with little or no train^p^ the quality of a search is to a large extent determined 

by the training and experience' of the searcher in the data base being searched. 
* * 

Thd second problein^rea hag to do wifh subject expertise. For research queries of 
greater/coptiplexity. than, "simple fact" questions, many people feel that the searcher 
sholildJ>6^a subject expert. It is felt that a librarian searching Chemical Abstracts, 
^ for ex^ample, cannot do a good job on some complex questions without a knowledge of 
chjelnistry. If a library does not have a subject^pecialist (e.g.., sciencfe, technology, 
business), then this problem cap be at least parti^|y^r^olved by havinjg the patron 
present for the soArch to]assist the searcher. '(This assumes, of course, that the * 

patron has some laiowledge of the search topuj' area.) > / 

• • * «5 
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5.2.3 The Role of the In-Depth Reference Searcher - ^ 

How much time .actually is spent by a public librarian in lengthy, in-depth, personalized 
searches for a client? The answei: seems to be that the majori|^of public librarians ' 
(including reference librarians) s^end very little time conducting such searches. 

Cjnline search^ could, perhaps, be Viewed as a custom information package or 
personalized library service. As such it could be considered a new type of service, 
not simply a faster, cheaper way of carrying ^ut an old service. 

In gene5*al, there appear to be few precise reference/information policies in public 
libraries which estkblisH liniits in terms of services offered, topics covered, patron 
eligibility, and allocation of staff time. Public libraries have been able to live with 
informal limits because the demands placed uppn reference service have not been that 
great. One major result of the DIALIB e;a)eriment has been to focus attention on the 
reference functi^^n in the public library^ Given the rapid advances in information 
technology, it would seem considerable Ihought should be invested in determining what 
the reference function of the public library should be in the future. 

Writes one commentator: "It would seem, that we have not honestly. or realistically 
decided upon a philosopjiy concerning the nature and scope orfhese services. How 
much service do we provide for whom, when,V where, and at what level?" (Ref. 8.) 

5.2.4 Changes to be.ExpeCTteS in the Library 

* The'introductibn of online searching into the public library setting gives the library 
a chance to change its image by^xpanding and deepening its- services. The computer 
^low^ the public library to offer personalized data base search services, for both 
individuals and^prganizations. Such Services can expand the library *s clientele, and 
make it a more useful information resource to these segments of the popiiSktion.^ 
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5.3. FEE -FOR SERVICE IN THE PUBLIC LIBRARY 

An important result of the DIALIB experinient was that, contrary to expectations,, no 
problems were experienced in the m&^hanics of billing and fee collection, and that 
comments by the patroBs were favorable to paying a fee for the search service. The 
only problemj-associated with charging for this specialized reference service in 
DIALIB was dealing with the philosophical concept of fee for service. Orice this was 
accepted by the administration, the actual mechanics bl collection and patron accept- 
ance. offered no difficulties. Furthermore, there has been no tendency to^ extend the, 
concept to traditional services within the participating libraries. We should note, 
though, that no study of non-users was made: we do not know whether fees deterred 
some individuals from usilig the service., 

* A 
L * 

We are well aware of the strong views on fee for service,^ best sulnmarized by two . 
quotas taken from the 1977 AmeWcan Library" Association meetingf 

. How did we get to such a point of horrendous surrender of principle in 4 
^ scarcely more than a quarjer-century since the simple moral declaration 
ii>4ne Unesco Public Library Manifesto, that a public library 'should be 
maintained wholly from public funfl||, and no direct charge should be made, 
to anyone*fo:^it$ services.*? ' * • 

" Erjc Moon^-Jfeauguf^ Address; 

^ * EresjfJeift American Tiibrary Association 

- * 96th Annual ALA Conference, 1977'. 

. Of course, jou want library service to be "free" or as low cost as you can 
' V make it. But is it better to hold to some abstract principle of freedom, and 
" V deny service? There is a history of things .starting out on some.commerr 
cial or quasi-commercial 'basis and then becoming free. ' Gradually 
society wiirperceive the importance of these services and provide t^ 
money to make them friee. • ^ ' . . 



\ 
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iSrvin Gaines, Direcftqr 
Cleveland Public Library 
96th ALA Conference, 1977 
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•As the August 1977 Library Journai states: 

The fee debate will be with usl now, for yearns to come. We've only begun, 
and by theftme we 're finished, weUl'hava'^fa^opinions froip the forma- 
tion industry, from government, and fr^m citizens ^d taxpayers about 
/how we 'should support library service, 

In the DIALIB reports we have tried to indicate t^e tinle^and cost elements, and the, 
many organizational and staff aspects involved in T)nline. search in the public library/ 
We hope that such factual information will be useful: to those on both sides of the 



fee-for-service question. 
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Appendix A ^ , 
^ LIBRAEY PROFILES 



*rhis appendix presents a brief profile of the participating pubHc libraries. For a 
more complete profile, see the Annex I vOluift'e of the Two-Year Interim Report, 
Ref. 2. ^ - • 



A. 1 .SAN JOSE PUBLIC LIBRARY ' ' ' - • *^ 

The Saxi Jose Public Library consists of a large central library and 15 branches, and 
serves a large municipal ar^^. The San Jose Public Library isihe only CIN library 
participating in the study which operate^a municipal reference service stJaffed by a 
full-time professional librarian. The reference staff at^the main library consists of 
19 full-tiiAe. librarians, and 7 part-time librarians. San Jose participated in^the full 



3 years of DIALIB, and continues to offer online service. 
A. 2 SANTA GETCRftrCOUNTY LIBRARY ^ 



' ' J 

The Santa Clara County Library isja large system with l^branches located throu^out 
the county. The DIALOG terriiinal was located at th§ research library ift Cupertino, 
the backup refl^efice resource' for the County. The Cupertino Library has a r6ferenc» 
staff of eight persons^. This, library participated for a little over^'S-years of DIALIB; 
it no longer offers online service atrtliis site. w - ' . 

A. 3 REDWOOD CiTY PUBLIC LIBRARY 

The Redwood *City I^ublic Library consists of a main library and t^yo small branches, 
l^edwood Gity has a reference staff of 5 individuals. Of the.4*Project DIALIB libraries. 
Redwood City had the largest turnover^ of staff during its 2-ye£tr participation. Although 
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all staff m0inbers performed searches, only 2 of the original staff conducted searches 

. throughout the free 'and pay peri(ids. Redwood City no longer offers online service. 

1 - . . 



A.4"*Siyii^E0 COUN 



The ^Saii. Mateo County Library is a large system" with 14 branches located throughout* 
the coujity. DIALOG service was provided through the Saij Mateo County Library 
Headquarters ^locate^J in Belmont. Unlike the other libraries participating in Project 
DIALIB, the majority of online patrons at San.Mateo were not "walk-in" patrons. The 
San Mateo County Library began with 3 full-time reference, librarians and a reference 
supervisor,^^but lost one of the reference librarians in the third year. San'Mateo 
County Library continues to offer online search'. * ' * 

A. 5 LO$JG ISLANTPLIBRARY RESOURCES COUNCIL " ' - 

The Lpng Island Library Resources Council (LILRC) is^one of 9 regional corporations 
administered by the New' York State Commissioner of Education. The Council consists^ 
of a group of public library ;systems (and their member libraries) ; libraries4n institu- 
tions of higher education, and other non-profit organiza^ons; and libraries in fbr- 
profif business or commercial firms. LtLRC participated for 6 months 'to provide ' 
subjective evaluation of the service. Online search is ndw offered for special re- 
quests only. . • . ' . . 

A; 6 CLEVELAND PUBLIC LIBRARY ... * 

"The Cleveland Public Library serves primarily the city of Cleveland, although persons 
from all Northeastern Ohio regularly *use the facilities. In addition to the central Main 
Library building, there are 33 t)ranche§ located throughout Cleveland. In September ' 
1975, the library initiated ''Facts for a Fee'\r- a fee-base{i reffrenfee^ service.-- iii 
response to requests for information beyond the scope of librkry policy on free research 
Und o^utside the library^s geographical arfe^ of refponsibility. .Facts for a Fee, aimed* 
at business and industry, ig available on a cpntractual basis at $25 per hour. There 
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is a minimum charge of $25. T^hiJ^staff includes 3 part-time indivi^als. The library 
participated for e'months- to provide subjective evaluation of the service^ and continues 



to offer online search. ' • 



• / 



/ 



A. 7 HOUSTON PUBLIC LIBRARy . ' ' . • 

' ■ - • . ■ • . 

The Houston Public Library serves the metropolitan Houston area and includes 
25 br^ches. A fee-based reference service, called Business Information Service 
(BIS); was in existence at the library for about l.year prior to the ihtf^uction of - 
DIAL^. BIS charges patrons $15 pe/ hour. However, patrons do not^have to go 
thizough BIS to obtain a DIALOG search. Those patrons who. have searches done in- 
dep^ndently of BIS are charged onjy for connect time and for offline prints * No 
charges are made for staff time. Currently, the reference department at the Houston 
Public Library hajn^s about 2l, 000 reference reguests per week. The library 
participated for 6 months^ but no longer offers online search. 

'«•**' * . • 

A. 8 -MINNEAPt^LIS PUBLIC LIBRARY . • ^ ^ 

v.: ' * ■ * 

* I " ^ ' , ^ • • . • 

DIALOG service at' Minneapolis is operated through INFORM, a fee-based research 
service of the^Minneapolis Public Library and Iijfgtrmatibn Center whose purpose is to 
provide infQnriatiorf on demand and in a usable form. The INFORM staff consists of 
one full^ime librarian, one part-time librarian, and one clerical person. Charges 
•for the service include $26 per hour for professional time, and charg^ for photocopy- 
ing, long distance calls, and any other'expenditures made on b§halJ of the client. The 
minimum charge for a new client ts-^5^ Since;1970, INFORM has handed about 600 
information searches annually. INFORM participated for 6 months and continues to 
offer online search; * ' \ ^ 

^ A. 9 TJJLSA CITY-COUNTY LIBRARY (INFO n) ^ 

INFO n is a fee-based re search "service that' charges a professioiiaLfee'of $25 per 
hour for doing research for clients. Any other coSts 'that are incurred during a 
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^ search, such as online searching, long-distance phone calls, or photocopying; are 
also direftly rebilled to the cl^ient. INFO n is currently operating only 20 hours per 
week and has a staff of one. "Search volume is increasing and they hope to be operat- * 

-ing full-tinie by January 1978. Clients are business and professional people from 
, large corporations, smalj businessmen, consultantg, government personnel, and in- 

^ dividuals. There is little use by the academic community since the Uiiiversity of Tulsct, 
although not doing oniirie searching in an, organized manner, 'serves its comiSuriity well' 
and the Tulsa branch of the University of Okla&qma^s Medical School does Medline " 
searching for its -students as well astfoi; the medical community. The questions re- 
ceived cover highly technical engineering and chemical subjects, management and ^ 
marketing data, and the area of grants and foundations. The library^articipated in 
the third year- of the study for subjective valuation purposes, and coi^inues to offer 
onlS^iB search. - • ' . • * " . 
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Appendix B • . <;;^ 
•LIBRARIAN COMMENTS 



We felt that it was important .that the participants give' their perc^ptions about 
.^DIALIB' without an in.termediary translating or "interpreting" what happened. We 

therefore have included this appendijc, consisting of two parts (1) formal statements i 
sevei'al librarians, and (2) comments frjjm maiiy librarians organized into v^pus 

topi<5 areas'. There are many differences of opyiion, and this is usually traceable to 
.^e particular librairy situation. The individuals andjOieir affiliation given so diat/ 

the reader can relate the comments to the Library Profiles in Appendix a^*, 

• . ' .'V' * : • 

B;l FORMAL STATEMENTS . 

# Barbara J. Campbell, Coulity Librariaii, County of Santa Clara ^ 

*The Santa Clara County Library, through our membership in the Cooperative Iiiforma- 
tion Network (CJN), was invited to "participate in'the experiment to show the value of 
the DIALOG service in a public library setting. ^ ^ 

Sev'ei:^ very positive results can be identified. First, in my.mind, is an e35)ansion ^ 
4h visibility to different segmehts of our communities. It seems incr,easingly apparent 
. to me that 'if libraries are going JgJ^ake'it" during^e-next decade in the scramble ^ 



for the liiiiited available funds, th^libra]^ prbgram must be madfe more vital ajid im- 
portant to'thB cenxmunity and particularly to the community leaders — those controlling 
' the, funds. DIALOG helps dramatically in this area^f A segment of our public dis- 
' covered that the modem pubU'C library has a ^dphisticatiori beyohjl( what they'^had' 
imagined. Equally important in our case^ "major segments of County governin6nt were' 
made "aware *6f DIALOG'S value, and^^xpect this to have very f avoidable long-range 

' \ ^ ■ • V 

*An, asterisk is uspd to indicate a comment that did not appear in the T\yo^Year Intefrim • 
Report. 
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Jjnpaot)yThis happ^s to be a current '*soap--box^* of mine -7 that libraries, musi'use . 
every- conceivable way to becom^ important to th^^ DIA^0G^h3lpp!^ ' ^ 

• ' ^ ' ' \': V^;?^ ' " . 

Second are^the benefits to thTa staff/ ^ur^ st^, while fibelin^ pushed *mid pUlledy ' 5* 
enjoyed the experience - the challenge, the Opportunity for prgfessi^ai* growth, and 
the pride ih offering a- new depth of service*, ^ • ' • ' / ' --^r* ' vV" . ' - 



Now to explain why wq dropped the^^progjam. ih the'thir^l ye^f * 'In^ur are^, as^ln liiOst^t 
. places, we are involved in oooperative .effojls, and We aire'^ctive in our .^Outh*Bay* 
Cooi5erative Library System . The ^anta Cla%^oi^^tibr^^ a !group'of oQ^un!^ 
ity libraries. My hope is th^t we will offer Vhe best in direct. community^ib^iary srei:- ; 
yice^^ven limited funds . This year we, have' had to face -pro'gra^ cuts to bSl^nc^ l^' 
available funds. ^In the DIALOG §;q)erMetot our. County has had two terininals; af our 
Cupertino Library and at the'^San Jo3.e5>ubli^ Usage cur^ntJjC. Supports 6ne,: '* 

terminal for nnr rpcrinn «nrl T fool wo eTfenM'frtllA^r fiiri 'c^^^'r^iz-,^^ '^^1^1 



As far as admimstering the p^o^am, i^ahy pr^is.sure:was,%cj^ . . : 

|taff . * Our Department ot Firi^cd^as :ai^ays .t^ken a. 1110^ hel^iful itatude^^iH woiWg • 
out new progranas in the most'directand imcompl^afed \^ W^had nbSroblemV;* ^ 
in setting up' the program.. ^ . . < ' •. '^^.^ -"^ . ' J ] , • / 

, ■ • ■ ■ •• . ,r'' ■ ► • . . . .--A- .■ ■ • - 

I Because the staff wanted to give- the seTy\xi&,;tiiey^Mm^e£ " "- 

W9;:ked out solutions. . • t^' ■ < ; ;^">, • V'' ^-^T' • v > f 

• Homer X. Fletcher, 'City LibrariVnir'City^o^ 

I have been most pleaded with the ^ucc4^ of -th^-JMAlibfe/p^^ fltst * r /* .-1'-?^ 

>v > • v.'-V. ^ 

experiment with onlin^.^information, r.e.tfieyar, the,pr65eciha»p^n a;T^iukbl4''learhinff .^^ 

6xperi6nce for admiilistratQrs' and refereifte^stafE^ " ag Well "as fh6:g^iieraVpuWi&?'W^'-.,': 

have been given the .opportunity, to 'obsek^e..;&rst ^an^ the. be*nefits, of thfsrhiehfir' ' " • 

s6phistiQ?fted service, and feel that.anW.{piei?sion,]in i^ajy. servlce.has. b^OTaft' 

available to us and, to. pur patrons. ' '• • ' ^' : J;.' ' - , ' ^ ''''JW' 
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At the outset, tay^»concerns surfaced frorri our point of view. First, the Cooperative/ 
Information Network Board of Directors took on the project without getting input to 
any extent from the public librajries who wouldlhave to do the work. Second, 'Lockheed . 
was hesitant about releasing budgetary information about the project even though it wa's 
supported, by public funds.. ^^^^ ^ 

^ - 

Juring the. fr^jfe period, the primary problem faced was th^of inadequate staffing. , < 
T^hdf San Jose -Library had lost thirteen positions in 1974—75; all from the Main Library. 
Because of the fact^hat no staff^g had been furnished thlrough the NSF DIALOG grant, 
our already depleted /taff resources were further strained as DIALOG became a high- 
demand service. A staff recommendation to terminate the experiment was carried to 
the City Council. Council chose to continue the project. Following this action, it be- 
came ne^essai;^' to adjust and reschedule DIALOG service hours. It is clear that 
staffing is a signifioant factor in |^e success of DIALOG service. We would urge any 
potential DIALOG uset to ap|)ropriate adequate additional funds for personnel prior to . 
installing the service. We do not feel that library patrons 'can benefit from the ser- 
vice to the fullest extent if overall st^f^g resources are strained. It follow^, too, 



that j^taff enthusiasm for DIALOG may wane under adverse staffing conditions, 

The fee/nonfee issue in;publiq libraries is, a philosophical -Question that was discussed 
^ thoroughly by San Jo^e Library administrators. The decision to charge fees was made 
'^^ by the' City^» Librarian following this discussion. This was.a cleax'choice in view of^he 
tact that, since, no funds. could be budgeted, a nonfee deci^sion would mean itehoval of 
.the service; a service which h^proven itself yaluable to-our,patrojns., 

f . ■ \ . ' * " ( ' ' 

W6 have been- so favorab]|*j^pressed'with the service and information avttilable 

through DIALOG that we are^- considering the possibility of an additional terminal for 

our Muni<5jlpal Reference Library which has just been moVed.to City Hall from the 

Main Librainr. . . ^ ' - . 
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' • Jane? Colwiu,* I^FOJI Research Libirarian, Tulsa City-County Library 

11^0 n^s growth sifice September of 1&76 can mainly be attributed to the demonstra- 
tions and pre^sehtations we have given. This would not have been p^^sible without the 
lielp of Itie DIAIj^IB project funds. We hstve^ given approximalfey 40 presentations - to 
individuals who 'stop in the office; to small groups of business or government people 
at th^ir facilities, ^nd to large groups of professional people at their society meetings. 
These professional groups include the Tulsa Chapter of the American Society for 

' Metals and the Tulsa GeologicafSociety, Our typical presentation includes an intro- • 
due lion to INFp n, a description of online searching, usually done using overhead 

"transparencies, and then an actual online demonstration using the terminal to find 
inforftiation related to the group's primary interests. These presentations are always 
successful, . bringing us new clients and furthering our word- of-mouth piililicity. 

Other publicity efforts have included: (1) Two good feature articles on II^FO S that 

appeared in the local press. Although they appeared in Marc^, we.are still getting 

4:esults. (2) We are ^Iso researching financial information lor a local business maga- 

zine and receiving a byline and free ad space in return. (3) Regular articles in our 

own newsletter INFO higfiliglit thfe service and particular data bases. 

' . ' ^' . ^ 

*• * * 

Our billing procedure fs simple. Clients are sent a statement of charges when the ^ 
search has been completed. They, in turn, send u^ a check. This has cause(*»no 
pr^oblems^whatsoever . An atternative to this pay-as-you-go. method i^ INBO EE's de- 
posit account systeni^. Somi^ client?" deposit a'$250 minimum witjirus, enabling them 
^ to a lower prpfe^sionaU search fee ol$20 per hour and' priority service. Costs of their 
. searches are deducted irom this deposit, thereby 'doing away with Wlin^ for each 
search, ' \ . . ' . • * • ' * ' 

, ^taff ^response to INFO n and ^Wine searching has all beeil positive . As a part of our 
partioipation in the DIALIB project, we requested some online time to be'u^ed for 



traijfiing.. Six members of {£e Business aiid Technology Department, staff and one 
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member of the Referenc^epartment staff attended a 4-hour training-session given by 
myself. The staff members are encouraged to uke the terminal for practices op actual 
searching, but they have not taken advantage of the opportunity, 'it has been jtnore effi- 
cient and QQovenient for th6 questions lo be referred to me. A demonstration I did for 
the library's Middle .Management Groyp was well received. In a library system with 
18 branches, it is important that librarians in the branches be aware of online s^ai-ch- 

ing so that patrons can be'referreJ to INFO U. . . ' * s 

. • . * ' / ' ^ > 

4 ^ . ' 

; . 

The^few problems we have encountered are not unique to INFO IL- Othex librarirans 
in Similar positions have expressed them also. ' ' 

\ ' • • 

The biggest prpblem is publicity educating the public to appreciate the value of 
online searching and use it. Personal demonstrations are our best method. Setting 
them up and giving them, however, takes time. Newspaper articles have produced 
results but can only be used to feature new servipes, not on'a continuing basis. Word- 
,of-mouth publicity is very effective but slow". In the long run,-, it will.be the most valu- 
able. The mass mailing which we tried at INFO H's* inception in November 1975 wVs 
a total failurfe. ' ,, ' 

Another problem is locating qui'^^copies of articled and reports found through an 
online search. .Interlibrary loan is usually the slowest 'alternative, but it is the one 
we stjU-use most frequeijtly. Thi^ has not yet put a burde'n'oh our interlibrary loan 
staff, but I do see it as a possible problem . ' ' \* 

. • -. . « * . . . ■ \ /. ■ 

I have no qualms about charging fees for the type^ of service INFO U provides, * 
Everyone' connected with any phase of JNPO II's inception,and opef-ation, from our ^ 

'Library Commission on'down^ has been supportive of this positi6n*. I strongly believe 
that customized service should be paid for by^^the individual wh^ requests -it. We are 
charging users fees for professionarl service we' offer, not for the'actual infdrma- . 

'tion we provide.' Anyone can buy or lease a terminal and sign up wittf a da!a baSfe sup- . 
pUer, but only a trained searcher with expetienae can use the online systems to their 

■ ^ \ ■ - ■ ■ '.■ ■ ■ 
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best advaktage. In the same rJ^anner, anyone c^n cdBlferln the libx^/ and search most 
of the samp infdl*mation in the printed indexes. INFO provides a cost-effective .ajjd 
efficient alternative to this do-it-yourself method. M^Wof our clients feellth^t the 
fees th6y pay for information are "worth Biiery cent" or surprised that all we charge 
is $25 Deithour. ' / - ' - * ' ' k 

Overall satisfaction with our service is very good. Ourjclients are mostly repeat 

users an5 very glad ^ service such as ours is available to th^. Our library staff 

f' ' . * 

. members are supportive ahd are^ad to be able to 'suggest an alternative to patrons 

whose information heeds cannot be serviced through normal lilH;^ry (^rations. Be£oj:e 

the (establishment of INFO II, we had to tell p/aitrons such, as this tha^No, we could ftot 

do the research for them" and then sho\^ them how to do it on their own. Now we can 

offer themr a choice^ , ^ 

/llrv summary, I believe the public library is the'plage^where the public should go for 

- *. *" ^ * 

online searching and that, in our case, the charging of fees has 'not been a hindrance 

/ •'^Lisa H..Nafef', Head, Adult Eleference and ]ft!feader's Advisory Services. RedVood 
City|Public Library , , ^ \ . ' ^^^"^^^^^^ 

Servicing a population of approximately 55, 000, Rqrfwopd City Public Lit^ary has a 
main library situated downtown, .a branch in a resid\nt^l area, ^ and ^upjio^s a ^mall 
library in a community center. 

Our computer terminal was allocated to the RedWobd dity Publiq Library (hence after 
referred to ^s RCPL) which was placed in me main librar-y refer^^iQ^/reading ^room. 
The terminal is Western Union Data ServiceV^pO Impact Pj^l^ 'aTg^*^^ per 
second and \^ not portable. Altliough we do not enforce a silence cofle, weNi;eceived 
so many cDmplaints about the noise the terminal generates while m service, that NSF 
agreed ,to/provide an acoustical cover for the mafchiqe. Since pxe cover ^^as instailled, k' ' 




we have, had no ccniiplain,ts about, the noi^eV 
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The RCPL reference s^aff consists of five librarians (including the unil supervisor). 
AH five librarians are searchers on the DIALOG system. Each librarian attended ^ 
one all-day introductory workshop on computer search techniques. Any additional ' 
skills have been acquired by experience and the use of manuals provided by Lockheed 
Information Systems. 

' \ 

ff member, Mp. Thomas Kam, 



4 ^ 
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The five librarians are genefalists, although one ^ , , 

has a more specialized knowledge of business, science, and technology than the others. 
Until February, 1976, RCPL ijan the computerized information retrieval system oij a ' 
drop-in basis. But the plannihg of a search strategy and the explanations to the patron " 
took up so mucH time, we began to require that appointments be made. The computer 
is online only until 5:00 p.m'. Monday through^ Friday Pacific 'standard time, and until 
noon on Saturdays, Fridays'and Saturdays we^e not gocM^days to* run DIALOG searches 
as RCPL is short-staffed on those two days each week, due. to rotating we^kepd• \ 
schedules. v , • ^ . ' . ^ 

Since June, 1^75,. we foi^hd that fnost DIALOG s^^stem users were-graduate students 
doing research papers or dissertations. Few users'were ret)eaters. Sonie busine^^s 
firms, prim^ily engineering firms*; ;ised the DIALOG system at RC^L. Most users 
of our DIALOG servic?^ were not ^ledwood City residents, nor wei*e they employed in 
Redwood City.* In fact, 50% of the users^cjid not reside or work in our county. The # 
maximum ftumber of searches we ran any one month was 39; the minimum was 7. We 
found that the staff spent anywhere from 30 minutes to* 1-1/2 hour^n explaining the 
\DIALOgr system and planjiing a search with a patron*. We' tried to ^ncourage patrons 



to be with the 'searcher when we ran their searches. 




* ^Not being used^ charging' for our services made us perhaps too aware of the cost^ 
factors of the searching. VWe-^bus spent' a greaf deal -of 'time preplanning our. searches 
and then running a vety tight, preplanned straj;6gy on the computer. Many patrons 
stated that they came.to RCPL' for 'DIALO^^rvice^ifecauie ii cost less fhan goi^g 
elsewhere. Frequently patrons aslcSd^s/t^ the^osT of their search to under 
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$15. This request increased the anxiety of the librarian who often felt h6r unden- ^ 
'^Eknding of the. data bases ieft much to desire and the patron would not get what he 
was paying for . * ' 

V 

To ease this anxiety^ and to be^air to^the patron, I would recommend that money be 
allocated in budgets to absorb the cost of errors made by searchers (such as running 
the searbh in the wrong ba^e)::- . ' ' • . 

DIALOG has expanded from 20 bases to over 30 in less than 6 months. As niore data 
bases were^loaded onto the system, we at'RCPL became less* sure of our abilitiej^ to 
meet patrbn^^requests. Sonie of the files were problems because none of us ^ave either 
the subject knowledge to^ understand the search request or an understanding of the 
standards and procedures^used in Compiling the index ox abstract services being 
fappeiaT In basesjike BlOgIS , we had problems compreTijsnding the'different codes "aind ~I~ 
deciding how to com*bine them to *'hit*' what our patron was^seekin^J in my opinion, - 
libraries who offer this type of service ^^ill have to s^enc} their searchers to indepth 
training sessions on the structurE ©f the data files a^d to more advanced ^vorks^lops 
on computer manipirlation. "Libraries will bavj^ tolDudget time and money to send their 
searchers tq^^the various seminars, offered by the ^publishers'' of the different data 
bases. « Costs range-from no charge to $150 o'Kmore per petson per session. ^ 

. ■ .. ..••').. " . ■• " .'^ 

The five librar^ians who' provided J^IAlJOGv services at the Redwood City Publid Library 
have cofh^Jto some'conclusio»^^;gLt^t)Ut J^ie"^^^ While the idea of computerized 

' information Retrieval is v^ry exoiti(f^,^'fSe DIALOG bases-are tpp specialized biblio^ , 
graphic tools, and too costly to bq^u^^^^^y the gener-al public. We believe these data* 
bases probably are put to better, more |fequent use in .a larger library. Our niedium- 
. size library does not have. the periodic^'and docuihent collections to provide the ma- 
: terials -cited in the bibliographies obtgdned through the compute)^. . This la^k" means that 
^ our patrons either have to wait for us, tp obtain the desired niatferial by inteftibrary 
loan or they go to another source. If xhe Reader's Guide to Periodical Literatuy;e were 
computerized or local statistics such as the crime .ratesvin, town, I think infdrmatioi^ 
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retrieval services wbuld be used by Redwood City resideata- The DIALOG'data system 
is not the ideal one we should be offering. Although we started this project with great 
enthusiasm, w.e find that we do not have enough staff to offer^as good a computerized 

. information retrieval service as should be possible with DIALOG, We do r^t have the 
time to takdf serveral hours each week to study^'the manuals and to pjactipe on the 4 

* equipmeifl^, * / a ' . • * *^ 

DIALOG did not lead t© an increased use of our library as a unit by community resi- • 
^ dents formerly not Jibra^y users, Most DIALOG users came to our library for that 
purpose only: to get a search dorie. 

At thS end of the NSF grant period, June 1976, DL^XOG services wei:e discontinued at v 
the Jledwood City Public Library for tl^ reasons^Pve described, ^However, we diO^^in 
an in^jaluable experience in'the use, of 6raipuEers~ih"ffie"lib Additionally, we re"- 

inforced and improved our reference interview techniques in working ouf search re- 
guesjs witli DIALOG users, We hop that when data bases that we feel can be more ' ' 
appropriately used^in a small library are, conipk^rized, that we will be able to offer 
sach services again, Mr, dscar Firschein w«as most helpful to uT th roughout the NSF 
project-as were his cdlleagues in|Lockheed Customer Services,. ^ ' 

• Charlotte 'Sakai, * Reference J^ibrarian, San Jose Public Libra^ . , ^' 

San Joce Public L^braryvhas always offered indepjh reference* service for free to our 
^ library users. One service we were not doing wa^ compiling bibliographies for indi- - 
^viduals, Siuce we were automating thejcirculation an^ cataloging systems^ it was a 
natural extension to offer an information retrieval system , TJie City/I^brarian decided 
to have DIALOG for a fee, charging the direct DIALOG cost to the .end user. Otherwise, 
we could not olfkr the service in these flays of budget G^jnstraiig;^ \ 



We found that people who do not normally use our library service were\coming in ta 
have a DIALOG search. Most of these people,- some cpmin^from 50 miles ^ay, 
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were graduate students or researchers who were willing to pay for their time saved 
on literature searching. DIALOG also made available ta these people indexes not 
normafly found ill a public library. (We 'duplicate about' titles in the h^dbound , 
format.) , ; .J - r f;j " . ' 

e have four operators plus a municipal refer^jj^ librarian doing searches. The 
operators were ^elected^'on their subject background and aptitude. To coordinate *" 
available staff time tS the number of DIALOG requests, we reque^d'that all searches 
be done by appointment. We found that appointments ensured time for a thorough ^ref^ ^ 
er^nce interview and having the patrjyj^ present during the ^earch. This method 
resulted in satisfied customers, ' ' • 

^In regard to our daily reference work,* we use DIALOG mainly for bibliographiCjf*. 
verification, as we use OCLC for verifying a book title. We also use DIAJLOG for 
subject (search) requests about twice a month. ^ Inhere is a budget for librarians' 
searches. / ^ ' ' k ^ 

Our; current level of DIAI^OG requests is at a.cl^mEortable number .for our operators 
^ - / ^ ^ ^s: — ^ • 

to handle without feeling strained. That is th6 main reason why we haX^e not to^ pub- 
licizing the information retrieval system widely. We could *not handle any increase 
without adding another operator. Most of our DIALOG requests areVeferred to us 
by word of mouther bylibrarians^in the Co^rai^ive Information Network. 

San- Jose Public Library tries to offer arid maintain those servi^^es requested and 
needed by the variety of people using^the public library. Our library users are be- 
coming increasingly sophisticated in their' demands for informatioli and materials, 
especially here in^^sllicon valley. DIALOG is justtmQ seirvice to meet such demands. 
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Ann Scott, * Reference CJbordinatox,, San Mateo County Library ' . ' 

'i . . 

^ This i.s an overview of 3 years of participation in the DIALIB/DIALOG Proj^t by a 
supervisor and participant. During the first year o'f fre'^iefvice, J participated ip 
tile ti«nmg, some of the demonstrations, and sohie of the searcHes; Nancy DeWath " 
did most of practical organization involving desiring of forms and procedures?" In 

.the second year, due to staff changes, my participation increased and has continued 
through the third year; this participation iriclud^d conducting searches, interviews, 
giving explanations to, patrons aVto'sei^ic^e'^and costs^ and attending training sessions , 
given by Lockheed and individual datii^?ise' vendors, ' ' * ' ' ^ 



Staffing has been a major problem since th'e 'beginning,', die iteference Divisjon is 
composed of genefalists wh^ are accustomed to do inVdepth manual, searches for subject 
^ requests. In the f-iPstTear, our complement was four full-time Reference Librarians, 
including the Coordinator; due to staff changes,' we operated at 3 full-time employees 
for most of the second and third years. As our regular workload did nc^ decrease nor 
were the hou'rs service (6ff hours a we^f reduced, considerable pressure was felt *^ 
by the staff., • ^ ' ■ ^ . c ' ' " • , , 

The explosion of data bases from the originaM5.or 16 to nearly 60 by ^e end of the • 
third year^^t us all busy trying ta keep current. 'The L^ckheed^ser. Update sessions^ 
were invaluabje; at one^of these, A)b§rt Dbnat^ demon stjateS' s nun^er of short cuts , , 
"and handed out examples of the sWft cuts; these became a' review source for ali%. ' 
The information provided about dfk bases seemefl skimpy to'us; the featur§ of ^getting 
the anformati^ online is kn ^expensive, one for^Data Bases which cost g^^'dollara.ah hoiir;; 
i^ould help a great deal if as Data' Bas;es;ay§ added, ^discrete' cl^aractetistics could 



appear with the general' information; this would include sample search; 
Jata base has its own individual characterisfics, one must constantly Veview'b^ 
starting a search; a comparative ^isplay of how to search for authors, free-text 
searching,,^ etc., would be most helpfu^^ Some of this has appeared in recent 
ChronologS, but this necessitates searching Chronofegs which is time-Consuming 




>. 



B-11 



v 




^5' 



UOCKHEEO PALO ALTO RESEARCH LABORATORY 

tOCX>4ffO MlSSrilS i J^f^ pi^COMfANY. IMC 



IMSC-D560986 



Training in general could have been better overlhe 3-year period, especially as new 
data bases are added. Perhaps this presents no problem in the Spe.cial Library, where 
hardcopy of some of the indexes are used regularly, but where the whole index is a^ new 
'area, f found myself at a disadvantage . ^ , J' 

Thp explosion of data bases makes DIALOG more attractive,, but brings one in contact 
with whole new world of abbreviations. When>,there were only I'S data bases, one had 
a very good idea what to suggest to^a patron. Now the numbet and variety of data - 
' bases, with considerable overlap, severely cbmp^cates this. The Lockheed publicity 
se^enj^o be of a market approach rather than a consumer use. The pamphlet which 
came out in the third year is one of the better' efforts,' bu^t even it needs to be updated 
for the newer data bases. During the first year, the best information we had game 
from Forrest Carhart*s METRQ System. It is too^bad that ever.ything has to be re-, 
invented by everj^one and that there isn^t mor'e sharing; perhaps'this is a responsibility 
of the Libraries concerned rather than Lockheed. * ^ \ 

Publicity his been a problem since tiie early days of the project and I have to assume 
it will continue. We had lots of vivid and attractive publicity, but it did not really 
attract a -great many patrons. Conmiunications is difficult when knowledge is^ common 
to all; patrons came expecting to see a computer rather than a terminal, to put in 
specific problems and get exact answers rather than bibliographies, to^ind an answer 
to a question for'which no data base was available, ^his is still occurring althbiigh a 
number of referrals dui;lng the third year came ^s result of professors, friends, or 
previous experience with the system when it w'as free. Evidently there are flyers 
around which still give the fc^r public library locations so some patrons really have 
to be serious to find the 2 locations. ^ ^ , 

The availability of DIALOG in the Public Library seems to me to be an added dimension 
of service as well as a step to changing the image of public library service. .The data 
bases are stiljl geared to research and science more than the general pijblic, which 
means the users are generally in business, college/university, researchers, but 
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rarely the general public on a general interest. If and when the, more cpmmon indexes 

such as those of the Wilson Company beccmie^ available, u^age by the general public 

^ /* ' ' 

will be y^ry noticeable and there will be a better acceptance by Public Library staffs. 

J . - . // * ' 

The problem of serving patrons from optside a service area has arisen but has not 

yet become critical; there are at Jleast tv\;o commercial serviqes available in^he,Bay 

Area; (Infoxmation Unlimited, Berkeley, and WE SRACi Palo Alto), as well as -the 

service offered at Stanford University and University o| Califortiia at Berkeley. As 

stated previously, some professors in business cours^ have added^lDIALOG search 

to course'requirements; this presents a probleiii but provides an experience for 

Students for future use.L ? 

\ 

The charging of fees presented no problems other than the^dministratixe work with - 
handling checks (which was what we rec^ved rather tnaixcash) and processing bills. 
I was the one who did this and it is' time-consuming; some of the time has been reduced 
since cost&have been showit on the search; this reli^ i^d the Librarians fro^ji hraving to 
figure computer time, chargei^, etc. The free perioc still hangs arpund and we still 
get calls about it, b^an explanation as to the pp4ject anidfits stages clears that up: 
We have had accounts op^ned By agencies, in^tutioii i,' arid businesses which, really _ 
worked out very well. Daring the third yeamve re^u red k down payment/deposit of 
$5 and the balance when results were r^ceiV^ed, All c f us'feel v^rj(^onscious of cost 
when doing^a search now that the patron /s paying the f\ill computer time, so more 
time is spent in preparing for the sea^h than'^in the mst. For my part, the past 3- 
years exp^ience has ^ven me grea^r skill in forming concepts and developing 
search strategy, which makes It easier to deal with patrons and the computer. ' ' ^ 

Hindsight is always better thanior^-Sigh^ I feel better in-house training on data' 
bases and their contend eould ]tia.MQ taken place during me free period. More exposure 
f9r Branch Librarians /Reference Librarians would belprovided. Better material, 
even if locally produced, ott the data bases and what thiy covered would be prepared. 
Hie preparation of some/focal aids for the searchers would be done. • 
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I feel strongly there is a place for DIALOtf in Public Libraries but librarians -have to 

• V ^ . ^ ' * - , 

accept.the idea .of computers and what they .do without* feeling inadequate to deal with 

them. Charging for'DIALOG service poes not^seem out of line; libraries charge for 
rental typewriters and for copiers', which are special equipment in a certain sense.- 
DIALOG is special also, but may become less so as mo^re data bases of common in- 
terest appear. . ' ^ ; * . 

t 

B.2 COMMENTS ' • " . ' 

* • « 

Coniments, regarding the DIALOG project were solicited from all the participating 

„ . , -» ^ ^ 

librarians. Comments were received from 19 individuals from a total of 7 libraries, 
both in written and tape-recorded form.. The individuals are: 

• Charlotte Sakai , 'Refer^ce Ivibrarian, San Jose Public Library, San Jose, 
Caiifornid ^ * \ 

• Bob Johnson , Documents Librarian, San Jose Public Library,- San Jose, 
L Calif orhia ^ ^ , ^ : 

V • Robin Kendig , Munifcipal Jleference Librarian, San Jose PublicLibrary, 
San/Jose, California 

• Rob Luchessi , Municipal Reference Librarian, San Jose Public Library, 
San Jose, California 

• Scotty McEwen , Science Librarian, San Jose Public Library, San Jose, 
? California . . " 

• Phyllis. Parjcer , History Libr-arian, San Jose Public Library, San Jose, 
California • 

• Judith Neufeld , Assistant to, the Director, .Long Island library Resources 
Council, 'Inc., Bellpbrt, New York \ ' . ' 

• Ann Landtroop , Head, of Business, Science, and Technology Department, 
' , Houst^, T^exas \ . ' 

• ' Carol Vantine , INFORM Librarian, Minneapolis Public Library, Minneapolis, 
•^Minnesota ' • • ^ , 

• Lojcs Thomas> Head, Research Center, Santa Clara Cpunty library, ^ 
. ' Cupe^^ino, California • • , 
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Dale Thompson ; Regional Librarian, Sante Clara County Library, 'Cupertino, 

California ' ' . ^ • ' • 

Alison Holtby , Reference Librarian, Santa Clara County Library, CufJertino, 

California " . . ^ • ^ ^ 

Charlotte Doudell , Reference Mbrdrian, Santa Clara Countjf Library, 

Cupertino, California - ^ . ' 

Eric JKristoffer^n , Reference Librarian, Sanfa Clara County Library, 

Cupertino, California • * ' f - | 

Lisa Ifeef. Head*, Adult Reference and Readers' Advisory Service, Redwood ^ 

City Public Library, Redwood City, California 

Nancy DeWath . Reference Librarian, San Mateo County Library, Belmont, 

California* ' ' ^ * ' 

Anna M, Scott , Reference Coordinator, San Mateo County Library, Bqlnxont, 

California ; , , ' 

B6th McNabb , Reference Librarian, San Mateo County Library, Belmont,* 

California 

Wayne Smith , Reference Librarian, San Mateo County Library, Belmont, 
California , . • <L 
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These comments have not been edited, but have been organized into topic areas, based 
an suggestions by Nancy Knight, We have selected the conWents from the TiWo- 
Year Interim Report that are still pertinent • We indicator comments submitted at the 
eVd of the third yedr with an asterisk, • , ^ ^ . * 

The tppic areas are: ^v" . . ^ , 

B.2.1 Effects^ of Online ^Seaijch on^Library Image^ • ' ^ 

B,2, 2 Effect of^ Online S^rdh on Allocation of Library Resources ' 

2 rs^ Fee^andJFree Service' - ' ' , 

B.2,4 Training and Allocation of Staff *Using*Online Search 

B,2, 5 Use 0f DIALOG for Reference ' \ ' - 

B,2, 6 Nee^d for Publicity to Promote Use of Online Search ^ . ^• 

B,2,7 Who Are the Users (and Nonusgrs) ' * , , 

8 Other Topics » , ^ ^, c 



B . 2 • 1 Effects of Online Search on Library Image 

Librarians suffer froni a bad image problem. We find people surprised that a librar- 
ian can access information without knowing much about the subject, ^ I am pleased as^ 
.,ta what online searching does for the image of tlfe librarian. Online search is a str^rig 
selling point which shows people that the librarian is dealing with information in a 
modern way, * * - ' . ^ . 

.1 have found the e^xperiment to be totally satis^ctory in enabling me to educate infor- 
majtioi^i users as to why an understanding of the organization of information is ii^por- 
, tant, and why it should be done. by a professional, as well as a subject specialist. It 
has really given a polish to the librarian's image in the eyes of business and scientific 
people, . * V, * * * j ' 

• - ■ . . j - ■. - 

The business community initially has some difficulty in understanding that we fflpe 
getting bibliographic citations, and that it is necessary to look at the source inaterials , 
to see whether the question can be answered. Once they get past that point,' the reac-. 
tiori of the clients is: Isn't this terrific — we have a much better krasp pn whether .or . 
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not our ^ubject has h^kn dealt witR'in'the lifierature^ They have also found the printout 
infbrnyitive, sometimes eliminating the ne6d to-go to all the source dcfcuments* 

' . — Vantine 
/ ' ttttt ' . / * ' 

\\y feel that it has realiy Deen ^ pleasure to have online search, and I think that, we 

e riding the wave of the immediate 'future ♦ There are several things that we feel i 
are benefits, one of them being the iin|)rovem^nt in comm^ity relations; \ye have a 
bigger audience than w^ hadVbefore anh we are attracting different types of people. ' 

As far as reference use is concerned, I think that we are 'fihding,that it is improving 
now that there are ihe added BaJ^es and we are using the service more* We are now 
able to'answer requests fod: 
online search. 



infd 



Tmatj.on that we could hot haye answered without 



\ 



ttttt 



Thomas 



♦Initially, library image i'^s enha^^^d through onlinc^searchiijg as patron identifies 
library with currefit information .Retrieval tecKniques. Ill the Ipng run, however, 
online search results consistently must ^ceed those qf manual 3ea3:che5 in appro- 
prrate citations retrieved f<)r th^flibrary image to benefit from new techriology* 



tttttf 



— Kendig* 



I really don't think that our having DIALOG in the library changes our image* The 
patrons who neecj a search find us, use us, and walk 6ut the door. If they nee(J re- 
^prints of an article, then they are back in the same grooye of using everydaJy library 
services. Out having the capabilities^ of computerized searching does not affect their 
perception of a library. ^It is just a service they need aiT^ wan^ and it happens to be at 
our library. - If DIALOCiw^re in a drug or grocery stored as copy machines ^re,° it 
wouldn't* change the way pat};pns^ think ^bout or use those stores. 

-McEwen* 

' . ) . . tt^tt ^ 

■ / ■ ■ • • . ■ • • ■ ■ ; - , ■ - 
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I feel that online searching is a very positive influen^je on the library image, The . 
^ service b'rir>gs in a number of people, especially iDUsiness people, who might not 
• .^l^oimally use the library. ' ' * - ' » 

\ \ ' ' ' y \ \ ^- [ -Parker* i 

V^-^ ttttt , ' . 

Online searching has not changed the library's image. to any great. degree/^ The avail- 
. ability of the service has fav'orably imprei^sed 'those who have used it,, but Jthese people 
are su^h a small percentage of total library users that the overall library image re- 
mains unchanged, The average library patron may display mild interest in the temi- 
nal, e.specially when it is b^eing operated s But the. system must be used to be appre- 
ciated. Since the Average library patron does;not use the service, it dbes not ^affect 
. him or his** view of the library. ^ • ' 

» . . ♦ ' —Johnson^, 

^ ^ ' , • . ■ ttttt ' . . 

B.2,2 Effect of Onlipe Search on Allocation of Library Reilources - 

Lessons learned: A library should ask several basic questions before adding online^ 
s^ai^h service: ^ * # ^ ' 

- Is there a real, not imagined, n6ed fqr itTyRovf does tHe service fit into the 
\. ^> ^overall objectives of the library? ' ' 

* — Does the library have the necessary Sinancial resources, time, peirsonnel 
requirements to dey elop this service ? > 

— Will this service groduce better results than ^^ternative. scarce (cost 
factors versus performance factors) ? J ^ < ' 
Will thie service contriJfute substantially to meeting library oBjectiv.es? 

. — Landtroop 

\ ttt-t1| ' ' 

The most Important comment I would make to anyone contemplating the initiation of 
online search is that it does take a considerable amount of staff time. The time re- . 
quired for training, workshops^ and searching has had a considerable impact on the 
entire staff. ^ . ' - - * . 
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This leads to the larger question of how online search fifs- iiilo the overall goals of the 
library. As in many other projects, I didn't .realize when we started' dut'all that was 
Involved, but as we continued," I began to see that there are questions that have to^e' 
answered. The. more staff time we put into online search, the "less time we ha^for 
othoy services. The question of which community to serve t^ien arises: afe we to 
serve a sophisticated, highly educated conynunity, or are we to sen^lhe community 
that has no interest' in ihis specialized reference service, but'has^her interests and 

• needs that^we are unable to fulfill. We are gomg to have to ^me to grips with this - 

problem. • I believe we have to' be flexible enough to include both; but, we may have 

to require the users of online search to pay for the full service, i.e., including ter- 

• minal cost and, staff linie so that the service does not become a burden on the library 
system.^ ' ' ■ , , . ' • " 

" . ' -Thompson 

• ' "^^^^^ ^ ' . " a- 

Overall, we are finding that online search requires. aTot of effort - publicity, traiAing 

just to keep things going. . It is not something that we can subscribe to and let sit 

• around until we feel like using it - like a new reference book. Each library '(public ^ 
arid otherwise) will have to decide whether it is worth the. effort. ' ^ 

' - . • - , " ; , •• - ■ -DeWath 

— ■ - . • ttttt 

. We have discussed- in our library the possibility of eliminating some.data bases in 
' pa:per copy because' they are online.. ' However, I do nofthfnk that that is a good way 

to look &t the problem, because if the online service is no. longer available for one 
' reason or anothe?., then one- has no backup in hard copyT^DatrEaSe availability im- 
.^plies that we don't have to keep_ duplicate copies of materials, and that we can also 

go into /(ficrofiche to obtain an enorlnous saving in shelf space (we could save 200 to 

300 linear feefpf shelf space by doing this). We could also save tjie binding cost,. 

particularly for references that are only checked occasionally with o'nline' searches . 

We can have available data^ase^ that we could.not afford to buy in paper, and it 

broadens our .entire scope of data retrieval. 

- Vantine 



tttrt 
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We have faced this resource qijjestion before. A lot of .the paper sources that we 
subscribe to are very expensive, and at the present time we do provide very expensive 
business services for a limited Audience* If you, look at the peOpleyWo are sitting at 
the business table, you will see the same persons^being served oyer and over again^, ^ ^ 

Thomas 

ttttt 

With a library as understaffed as biirs, diverting staff to do^nllne*&earching doejs 
affect other library services. This i& further compoundedlbecause the t^^pe of person * 
who i¥iakes an effective DIALOG operator is the typ^ of per son .who is also a very capa- 
ble librarian. So the best librarians are drafted as DIaIoG operators. Th'eir DIALOG 
duties giv^ them less time to^evote to the traditional/public library duties. The other'' 
staff members m.ust shoulder this extra load^^ possible. The effect of diverting staff 
to online searching often results in a slight decrease in the quality of traditional library 
services. Libraries with a chronid staff shortage may be unable to offer online search- 

7 ' > 'J ^ ' 

ing in addition^to their traditional library servl/^es. ^ * 

<^ 

* - —Johnson* 

ttt/-t, - •• . : 

Diversion of staff from general reference to DIALOG searching may decrease overall 
level oi library reference service at p^ak demand periods. DIALOG searchers who 
are also reference librarians should be^^scheduled to do searches during slack refer- 
ence hqurs. 

;:::Kendig* 

ttttt^ • ' ^ \ 

Naturally, online searching requires a commitment from tlie library man^gemeat,.. 
The majo"^ change would be in allotting staff tolihe project. Extra thesauri anid such - 
materials are needed, of course, /but the cost here is^minimal compared to librarians' 
. time. Of the 20 librarians workipg in the main library af 'public service desks,, 4 of us 

have been trained to use DIALOG. Over the past few months, we have probably run 

between 30 to 40 searches each month. Addirig in the time required to explain the sys-^ 
tem, make. appointments, and thfe related duties of notifying them when^'printout arrives, 
etc., let's say 50 hours a month are now spent on DIALOG. This amounts to roughly 
12-1/2 hours a ^yeek out of 800^ week for all^librarians (20 x 4a hrs/wk) - hardly a 
major commitment. 

V y 

' ^ ' — McEwen* 

tfj|tt 
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B.2.3 Fee and Free Service ^ 

t • , » 

Our major hurdle was jthe decision to charge fees i\x a public library It was decided 
that the library would absorb the staj^f time, Connect tiirie, and overhead; the terminal 
would be paid by NSF; knd the DIALOG cost would tejjaid by the patron. If we did not 
charge Ihe patron the^JDlALOG cost, we would not be ahte-to offer the service.,^ We 
hav.e had no requests for refunds or defaults by our DIALOG users. 

' ' — Sakai 

- % ' 1 1 1 1 1 

The fee service has n6t presented as many problems as we had feared. , If anyone 

obj^ted to the public library selling a service, they didn't do so to our fades. We 

have had no problem that I know of , with patrons failing to pay a balance due, bounding 

checks, etc. We have a checks-only provision that works wdll for us. I'm sure that , 

users would like it better if we accepted cash and credit cards, but no one has beeA 

terribly inconvenienced (although a couple of times staff members have written checks 

* on their own accounts for people who showed up with cash only). We doTeeL the pres- 

sure of having to search, economically when spending th^ patron's itioney; beginning 

searchers find that^articularly discomforting. They have dealt .with that by practicing 

" ^ , .... 

a search on demo and then doing it' ''for real" as a standard se&rch — a luxury that we 

may .not be^'able to affoi:d in the future. The standard searc'lt promises some relief in 

that si{;uation. When we are more confident (with ourselves or the subject of the 

Asearch)^ we prefer custom, so that we can get the benefit of our efficiency. The prob-, ' 

lem, I think, stems from the strangeness of having sotneone erse, in essence, pdfy for 

our tiihe, I have worked other places where ou» time was billed to clients (not librar- , 

ies but consulting organizaltonsj . After a little initial discomfort, staff members' ' / 

learned to accept the idea that whatever time we spent was billable, that niistal^ies, . 

false starts, and 4|iefficiency were a part of any human activity; ^ • 

• f ' ' - . r ' « . ^ 

J* * ' 

If we did enough DIALOG searches, we would eventually realize. that no search is flaw- 

> ^ * 

less, and that the flailing around that we do •sometimes, is a legitimate part of the search. 

' - " . / " -neWath ' 

■ . • • ' ^ tttrt'- ■ ' ■ ^ ■ 
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WejyAe.had a number of people in library systems around the Twin Cities inquire as 
to nonfee use of the^ terminal. Up to the. present, we have limited use \o fee-papijg 
INFORM clien/s. In 1977 a pilot study of fr^e online sea^rching for the general patron 
will be undertaken. The subject librarians will be responsi|)le ior determining whether 
a terminal search is th^ mo^t ^cost-effective wa^' of answering a 'question. We are 
finding that the average search cost runs $20 to $25 for a client, not incl^uding our 
DJFORJVI librarian fee^ -(We have*]iad searches ranging from $5 to several hundred 7 
d(Alars]) It is such a reasonable price that I feel that online searching is a tool that 
should be available in libraries every\^here: . . * t 

. * ■ — Vantine 

' ' . . ^ ttttt''.^ • ' , ' ' • ^ . 

With reference to our use of DIALOG to answer reference questiohs, I continually 
worried about the fairness of charging some patr9ns ^d not charging others. The ^ 

cpite5:ion sometimes ilientioned-as the appropriate guide -* use online search only ^ 

: ^ ' 

^*to save tinie" ~ is not workable in actual practice . I found myself looking at the ' 
patron's address to feet an idea as to whether he or §he could afford online search. 
This affected my decision as to whether .a fuUjonline search %vas recommended or not. 
' ' ' - ^ ^ " . . — Thomas I' 

We are cbncemgd more than the » public- about tjharging a^fee for searches. The public 
seems to be able to separate the online service from our free refeue^e service. We 
i^e gOiAg to have to set up a^fund, though, tq handle the times^en we use online 
search for our own referenceyquestions and fbr bibliograp^c searches. 

. * — Kri^stofferson 

, . ttttt 

Houstori Public Library has a long^ history of doing indepth feferencfe wprk for our 
patrons — for free . This includes, of cours'e,' literature searching^ If Ihese manual 
searches are successful^ theh electronic searching is ridl necessary. This approach * 
(doing manual searching first) certainly does affect the use of DIALOG. , 

Houston Public Library lias no difficulty at all in cl^iarging for patron use of online 
computer time. If a patron/client wants a literature search via computei^, he will 
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have to pay fo-r it. A library does not have to have a "fee-basfed service" before they 
can have DIA-LQG, nor must they have DIALOG before they havl a fee service. 
' . " ' ' ' , ~ — Landtroep 

Since most of our users are college students or in research^ they have been gla^ to " 
trade money ioi: service. Everyone seems to. be working with linlited time, and th|' . 



My question is how much of the service should be paid for by thg taxpayer? At present 
tiixie, the librarians' time is paid by the library. .The patron pays for' the connect time 
and printouts. \ye have had very few complaints from patrons who felt they didn't get 
;thGir moneys worth. Most are thrilled with the results. Now should they be paying 
for the librarians time also? That's the difficult 'question. ' ^ \ ' \ 

' • . . ^ ■ 

Making- rough generalizations, we nojv spend About an hour^vvith each E(lALo6 patron ' * 
and many times we spend this same amount of time on a telephone^ reference question, 
so I feel that the liblrarj; is justified in off ei-ing this service without charging the patron 
for the librarian's -time. . ^ < _^ 

' . • • . . " - . ■ .< : ^ ' .... 

, •• -McEwen* ' 

. ' . ' ■ ' "tftrt"^ , ' ' " ■■ 

)ilthough many librarians feel strongly that the pul^lic library should not offer a ' - 
service for a feej I do not agree.' I feel that one way or the ofh'er the public is paying ' 
for the library. Since DIALOG attracts a j'ery special clientele, willing to -pay fo^ the. 
service, I feel'fhat it is useful and desirable. ' . . ' • 

' . , — Parker* 

. \ ' '. ttttt., ' ■ . ' • • 

The question of chargirig fees for selected public' library services is an emotional 
issue. Although some librarians become indignant at the thought of charging any kind 
6ffeefb>any kind^of public library servicAs, the DL^LOG operators at our library feel 
no such qualiris.about charging a fee for online searching. The economic reality is 
'such tKat ther6 is no way tMt the city of San Jose wqyld completely under\^ite such a 
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specialized service for a select few. AS it is, the dity is already subsidizi^the-^ » ^ 
service by not charging for library staff time or the use.of the terminal. The library 
can and does offer online searching at a very reasonable cost, well within reach of all 
whb need this type of service. There have been no complaints about the fact tl^e library 
must Qharge a fee for thi^ service. All who use it agree they received good value for / 
• theij;r money. - ' ' • ^ 

- * ' . — Johnson* 

' ■ - ' ' . . ttttt ' - ' , ■ . 

■* < ' . ' 

B.2.4 Training and Allocation of Staff Using Online Search - • 

Training Programs * ' ^ ' ' ; 

, «^ . . , • ' 

I feel that the mo'st^.^^eficial training session would consist of two or three people at 
most with an experienced trainer some time after they have read the manuals. We 
a?€ jjitelligerit eno^^ to^ a±)sorb the basic idea of hpw the system works from the 
printed material; in the future it might be more valuable to, read it first, ^t the train- 
ing session one could discuss the finer'points aild have hands-on t^ainii^g. 

There should be training "beyond the initial 1- or 2-day session, preferably after the 
librarian has used the system for awjiile. Advanced training should be offered on4i^ 
location, sin^ce librariaus'find it hard to get, away. It should occur ^k'e a year or 
maybe every 6 months. A minimum of three people should be trained to cover absence 
due to illness, job change, and differences in subject interest. * , ^ 

It' was very diffiqult forjus to, become acquainted with the. new data bases when we 
were not familiar Wit|i them in hard copy. Fdr example, we were familiar with 
t'Duhdation Center ^aferials, so it was easy t6 use it in the. online form. But when 



we,€^glt .with Chemical Industiey- Notes or Oceanic Abstracts, which we weren't 



familiar \vith,ywe no longer Were confident about ^yhat,we.were doing. ; 

* k. 



* ^ • — Vantine 



/ 
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" My training as a DIALOG opeft^ator began 4 months into the fee period. The initial 
training was ione by an experienced operator who explained the key commands and 
gave a demonstration on the terminal to illustrate their juSe. Although encouraged 
* , tQ use demo time to practice with DIALOG, this brief introduction did not give me 
enough confidence to do more than one or two practice searches. 

About 3 weeks after the in-house training session, a Lockheed-sponsored workshop ' 
^for novice DIALOG operators was given in Palo Alto, This workshop was very helpful/ 
. It presented a comprehensive review of basic DIALOG search commands and techni-^ 
quesj'thus summarizing bits and pieces of key information given me by other operators 
or picked up on my own. In addition, there was k chance for hands-ron practice with 
DIALOG terminals, which reinforced tHe informatioi? given earlier in the workshop. 
Although in-house training is useful, it is no substitute for a formalized practice * 
session/workshop. 



ShoTtly after attending this workshop, I began doing fee searches. I did very -few demo 

searches for practice. In contrast to 6ther operators who began doing fee searches 

after some months of practice during the noiffee peridd, I was doing fee searches with 

very little prior experienc^. As a result, my first fee searches were rather pooi:.;^^ 

Errors were made in typing, command syntax, and; search logic. These searches:^k 

twice as long to do as comparable searches done by experienced operators. I had " i 

trouble keeping track of the commands given^and sets majtripulated earlier in the sear.ch, 

and often had to go back and retrace previous steps. The fact that my inexperience .^^s 

costing the DIALOG patron money only servedTo increase my nervousness and unease 

during those first fee searches. • . ^ ^ // • r 

*r • ♦ . ' . ' . ' 

* * 1 " 

. \ : 

Nevertheless, I was learning. After a dozen fee'^earches, my search time dropped -l" 
while ni^ confidence an4 effectivenoai rose. Soon, being a=DIALOG operator beca^ne 
an enjoyable occupatiot^ and has" remained so ever since. - • ' . 

becoming a DIALOG operator in the middle of the fee period was not easy. "Despite ' •' I ■ 
training sessions and demo time available for DIALOG practice,* DIA'LOG proficiency 
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can be gained only by doing patron-initiated searches. I just regret that those patrons 
"fprVhom I did iny first fee searches trad to unknowingly subsidize my DIALOG 
education. * * • . " . . • 

— Johnson 

' ♦ . ttttt ' - 
Since I knew nothing about computers or ^et theorjr, I didn^t have the foggieist idea of 
wllift was going on initially. I felt that I didn^t havq enough time to train oh the^ter- 
minais. . Another training session that cam$ 1 month to 6 weeks later was of some 
value, but we should h&ve had i^j^thqr followup'a month after that. When we went, to 
the workshop in May 1975, almost at the end of the free perigd, we learned about 
things that we had never heard about before (stacking, for example) • 

^ ^ ' ^ * ' - Holtby ^ ' 

• ..^ ttttf; 

One of the major problems that I foresee for oUr continued use of online search is that 
of not having enough searches to. keep our skills current. We have seien how' rapidly 
we get rusty, and How difficult it is to pick up on new bases if We have no pressing 
need to use them. It is also Itkely that the money for training and for practicing on- 
line will be c^t down or eliminated from t^e budget. But, ^they are essential in order 
to keep us even modestly competenf," especially with new bases and search features 
bein^ added all the time. . . • . 

' ^ ^ * . --DeWath 

' * . . • • ttttt 

My .only comment is that there isn't enough hands-on time. A g;reat deal of information 

, < ' . ' ' 

is given in lectute form and with slides, etc., btit there is nothing like facing a real 

problem and trying4jo figure, out how to befet approach it with ^ trained person on hand 
to correct your strategy* That is the \vay I learn best. * • ^ 

^ • ' • ' ' . o -McEwen* \ 

. \ ^ ' • ttttt ^ ' ' ^ 

I was not pleased with my 1-day ^introductoj-y training -given by Lockheed. This was* 
not due to the instructor'; ratfier, I feel that a differait approach is required. Specifi- 
cally, there were 20 people, and only 3 terminals available.for the (raining session. . • 
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a l , r*!* __ - . \ . . . ^ 

fortunately, some of the attendees with prior e^epience in DIADOG took over the 
^enninals to search their worlc-relateH questions, leaving little time for the rest of us 
to obtain online practice, I believe a better format would allow each participant a fixed 
ainotWfe^.Qftime on the^ terminal with a given problem to search and solve. . \ ' 

^nning searches^ince February 1977. It took about ten or twelve 




, searches before I felt really cona£Qi:*table on the terminal. I am still not comfortable 
in certain data bases. .Lwish that in tiie tr^inin^^ssions there was. some discussion 
of the different data bases without the presumplion^lfeaL as librarians, we are familiar 
with all of them. ' 

— Parker* 

^ ttrtt' ' ' \ 



- staffing Arrangements 



Staffing has been the biggest problem created by online search at San Jose. Since we 
did not add any extra staff for online search, we began to feel the strain as DI4XOG 
requests in^eased.from San^Jose State University students. Fortunately,' we had\ 
help from a SJSU librafy school student who received units for her work'; Linda^ 
Erickson helped us through our busy:free period. V 



During the period when fees were charged, the four operators were able to handle 
about 50. requests a month comfortably. Each^rf the operators specialized in a cJouple 
of data bases, assigned according to the operator's^ strengths. Ilowever, we conduct 
most of pur searches in EEIG,* a result of our high student usage. ^ " ^ . . - 

r t 1 

I think it would be better tq'have a staff member assigned full time to do all the 
searches. That person would be able to study .and receive advanced training in each 
data base and^ thereby do rtiore skilled searching. Online search servipe takes time. 
For evety minute online, an' operator spends 31 mines'" offline. This time does not 
include the numerous inquiries we receive. Staffing is a serious consideratiwi in'de- 
ciding to offer online search. ^ . . ^ ^ 

* --Sakai • 

h : ^ ttttf . . - * ^ ^ 

' ■ X ■ Ill - • ■• 
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We were »ever overwhelmed by the workload, but our staffing arrangements are more 
flexible than those o]& a library whicli must staff, a reference desk.^ We did hav^ some 
slight problems with distributjioiji 6jf requests among the staff We Teave requests -in 
an in-box until someone picks thepi up to work on-them; Occasionally a request would 
get bypasseds;(e specially a messy one), ^ith everyone thinking that scJmeone else would 
do it -^but that is more a function of our way of distributing workload, than anytlji-ng 
directly related ta online seaiKjh. We.hav6 talked about assigning requests, either m 
strict rotation or according to- different subjects,^ but the staff was unanimous in its 
feeling that the current procedure was.prefearabiepboth-in ter;ns of distributing th^ 
workload f aitly and getting thp searches dofne with the l^ast delay. 

> » ♦ 

We have avoided assigning siJecific bases to individual searchers, because tyat would 
mean a he^y load for people doing the popular bases, and couW njean that a request ^ 
would need. to be done in a hurrj without the "ap{)ropr']^te" person' being available to 
dcf it. However, that w^uld make it easier to keep up-to-date .on changes^in the 
ba^esi^ 

tttt-t 



^ ^ . . . / • - DeWath 



Since tti0re are only 4 DIALOG operators, we do have to make appointments at least 
24 hours or more in advance. We avoid Mondays because that is our busiest day. 
Sometimes, 'during^ our busy season, I dd feel that online searching does detract from 
our overall reference s^xvice because we are stretched very thin f rom^a staffing point 

of view. ■ ' - •, . . . 

* , • ' ' - ' • ' — Parker* 

•- ' * • ■ ' ' ' ' < " K 

.ttttt - . • - : , ' ' . 

There are 4 DIALOG operators at this library (San Jbse).^That rs'a Sufficient number 
to cope with the 30 ta40 searches dcaie monthly^ And it ensures that there'fs usually . 
at least one trained operator available to answer questions about the service and set up 
appointment?. If the number of monthly searches were to increase slightly, more, 
operators .Would have to be trained.. Not all librariajis have the potential to be good 
DIALOG operators. .The operator must be of above average intelligence, logical and. 
flexible in thought, and, capable of engaging in a man/machine^IALOG. These qualities 
do \imit the number of potential operators even in a large library. 

0 * , . . — JohnsoA*. • 
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Number of Operators . . ' ' ^ , ' * 

, From the user's pointp^ view, I suggest that a single opei^ator be utilized. A" single 
operator can become ^^pecialist; he gains more expertise by-doing more searches. 
This system is preferable to spreading out the searches ^ong many operators. * 

^ ^ I - — McEwen * 

* ^ .'V- ' ttjttt ' • ' , 

^ It isomportant that there not be too many joperators because then you have a lol ()f - 
; ipeopl^^o have oi^y a' surface knowledge of how to perform searches. . On the ptheV 
hand, one operator dpes not work out well in a public library situation. It is difficult 
for one person to cover many siflbject'areas, and from a staffing point of view, it 
doesn/t work oat well diie to illness, vacattion, etc. ' 

• ; ' — Kristoffersori 

• , ^ ttttt. ' 

, Sta£^ Attitude and Ability - ' r' 

The key to a successful online search operation ^s the staff. If the people who will 
be working with it are not efithusiastic, th^ use of online search s^fvihe anywhere is 
almost guaranteed to fail. The patrons foiow of online search onlkr thi^iugh us, so if 
we are skeptical ox reluctant, or not interested In the patron's quWapn^ the patron 
will pick that up. If we aren't convinced^of its value, we can't ^ell the patron on it; 
but, on the. other hand, if we seem confident that we^have gotten from DIALOG the 
best it can provide, however much or littl^, the patlron is confident that the search 
has been as successful as possible. , . ^ ^ ' - 

' * • ' ^ ^ - DeWath 

• \ . ^tt.^tf , ^ / '/ ' 

The attitude of the staff and adminfstrationrtnust b^ supportive when a library decides 
to offer online search^. Many of our early .problems intensified because of a poor atti- 
tude. A§ our attitudes changed, the problems with fees, workload, and terminal/^ 
computer became mmia'geable. 'Ijt's becaifse of this ppsitiye, supportive attitude of ' 
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Sail Jos6 Public LibraVy. 



operators-and pf administration that DIALOG will continue for a third year at 



Sakai 



ttttt 



I bkieve all the qgeratoES feel as enthusiastic as I do ahbut DIALOG*. It's a^ fantastic 
tool and we are very fortunate to have it. Abilities variand' we each h'ave certain data 
basis. that we are more comfortable with, but, in general, ,1 feel any of the operators 
can handle any of the questions. It's good to have morL thah one person 'involved so 
that if, a problem does come up, you have someone elsfe to.Jielp work it oujt^ 

— McEwen* 

.'.-^tttt 

Another problem is the relation Between DIALOG operators and nc^perators. Most 
of-tlie staff not connected with DIALOG have only a vigue idea of what^nline searching 
is about. They are ig-norant of what DIALOG ?an anrcannot do. This is understand- 
able since one must work with the system over a period o^ time before one can fully ^ 
grasp its capabilities. Biit it does create situation) 
ments about DIALOG to patrons whicJi are untrue, 

later' refute. ' Some type of education about DIALOjJ for .ijionoperators is needed. Algo 
there is some risentment among the library staff Lwar^ operators \vhose appointment, 
with a DIALOG patron runs over the allotted, hourland who is subsequently late in re- ( 
lieving another librarian at a public desk. Someilstaff aire annoyed when they must 
cover fo::^ operators who must attend to DIALOG-irelatefl business. To be sure, this 
ty^e of resentment is not overwhelming,* but it i^ present. 

ttttt 



wheije nonbperators make'state- 
d which DIALOG operators must 



V 



— Johnson* 



1 



Interlibrarv Coot)eration 



..I 



An alternative to 'the kind of arrangement that we haVe now is one in which one library 
acts as a central search facility for a large njzmberl of libraries, in a more formal ^ 
\ arrangement than we now have in CIN. We have had so little participation from special 



ERIC 

hiiiinniiinrfTiaaaa 



LOCKHEED PALO. ALTO RESEARCH LABORATORY 

I 0 C K M I I 0 M I S $ I I ^ S M * S > A C I COMPANY. INC 
A $ U I $ I 0 I A • Y O f I 0 C K M I I 0 A I • C | f T * C O y 0 • A T I 0 N 



"1- 



LMSC-D560986' 



, libraries iffX!IN that I suspect that they never learned enough about DIALOG and/or 

the DIALIB project. Including a larger area\ especially San Francisco, would prob- 

ably increarse^e use tremendously. The question would arise, how Would the cDst bfe 

shared, particularly the staff costs. In the East Bay, the public libraries are tiding 

an arrangement whereby online search requests are sent to U.C. It will be interesting . 

'to see how that w^oVks out, especi^ly sinpeThe pu-blic librarians have been given no 

/ special training regarding the kinds of requests tliat are appropriate. 

, '■ . -DeWath . 

; .V ttttt . 

^ rf> » » * ' 

Aside from' a few requests'froip some. special' libraries, we haven't been in direct 

contact with other libraries re DIALOG. Other libraries do send pati^on^ to us but 
therg hasn^t been a marked increase or decrease in i^terlibrary cooperation because ^ 

of DIALOG. ' ^ ' ^"^^ ^ . • - ^ \ 

, , : -McEwen* 

_ • ; - ttttt * , r y '^-t * 

B.2.,5 Use.of Dialog for Reference 

Reference Use ' ^ • . ^ 

Online searching opens up a new vista for the smaller library as well as the research 
library. It provides the small library with capabilij;ies that they never had' before and 
enables them to^provide better service^fo the public, tl would recommend online search- 
ing to any library that cap afford it, no matter how small the library. I f^el that it is 
a tool that can enhance their collection imJ&ieasurably.. ^ ' ^ " ' 

Interlibrary loan and other networking situation? make it possible'for people to get 
copies of needed materials at little orjio copt. This means that online bibliographic 
•"searclxing enables the person having access to a vei*y small collection to find.ont what 
is available and begin to do a really decent literature search. It may take them a little ' 
longer to obtain scarce materials that .aren't immediately available, but it.is well , 
woi^h it. , ■ . • ^ 



Vantine 



ttttt ^ 
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The ability to do full-text .searching has made it relatively easy to verify a biblio-y 
graphic citation when only limited information is supplied by the patron. The ''hu" " 
rate for such searches ife high which means, that a special coUection like Municipal 
Reference has aniaddit^nal tool in helping a sometimes demanding clientele. ' : 
^- " ^ / V ^ — Lfichessi* 

'•V , - , ^ ^ ^ trttt • •■ ^ . ^ ■ ' ' - 

DIALOG wai^used for more than patron-initiated searches* We, ^s librarians, became 
'interested in the possible uses of an information retrieval ^stem in daily public ' 
library reference work, e*-^g., bibliographic verification and searching for a specific 
answer • More time is needed to determine^whether a system such as DIALOG is a 
useful reference tool. It is unfortunate that^there is np current study being^conducted ^ 
on this, aspect » , ' ♦ . 

■to ' 

We tried using DIALOG in our reference work. That is, we usedjt to find a specific 
answer to a subj^t query. It was used tqi^ave ^taff time in searching indices zxidfo 
making av^lable specialized indices. Our "hit" rate, was about 25%. It was hoped 
^that the mil-text <!japability of DIALOG would zero in on the specific topic. " We need 
to do ];nt)re reference searches on DIALOG before any^decisYon can be made about its 
usefulness in public library reference. . ' . ^ \. 

^ • ' ' -Sakai 

ttttt ^ ^ . . 

Five of us received a 1-day DIALOG training session at the library in August. After ^ 
the training session, we practiced diligently for a while and talked A\dth^ouf friends ' 
here in the Twin Cities who had the system, trying to find out how to best nse the ^ 
system, \ ' * ^ ^ ^ - ^ ^ 

Originally we limited online searches to those that we knew wQuld be successful, iiC., ^ 
those that we could plan a strategy for, and for which there, was a. data base we knev^r 
had th^ material. We did hot do much in September and'October because none of the - 
INFORM questions seemed suitable for* online search. However,, oUr'sfea^ches in 
November indicated that there was a great deal 'of information in the bases which could ^ 
be retijieved once we bebame more base oriented. ' ^ ^ ' 
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Because of 'a newspaper article in September describing INPORIVI and our oaline search 
capabilities/ the request for^our service incrdSsed quite a b^t, "People were interested 

to see whatr the c4)mputeir couM do for them. As the°jiumber of searches on th^ system * 

^ > ^ / 

JLncreasedrour proficiency increased;. we used th^ logic more effectively, truncated 

mor\effi/iently, and began to understarld thfe peoi^ia^^ttie^''of^each,<^ata base better. 

Our searching results then began to show a noticeable improvement^ , 

As DIALOG added Hew bases such ^s Science Citation Indeed an^I Dissertation Abstracts, 
we were able to do searches thaT^ had not been able to do^pre\4ousIy,^ and we de- 
veloped additional skills for Chem Abstracts and for NTIs which have been most helpfCFl. 

We feel that DIALOG enhan^edMJie. service that we provide our paying c^iehts, many- 
fold. U has provided an efficient, interesting, and informative backup service to the 
. kinds oAresearch that we already do. It hars alscT enabled us to handle questions that, " 
formerly, we would have had to' subcontract because of a lack, of sufficient re'^sources. 

t', ' . -^iyantine 

DIALOG is an adequate tool for the solution of reference questions, which can be 
answered through compilation of bibliograpHiqs. DIALOG is less useful for ready 
reference type questions which are generally answered with one or two word factual 
replies. . ^ 

\ ^ . . ' * ' -Kendig^ ' 

' * ' - tuft ^ ' ' ' ' ' \ • ^ 

1 feel that there is quite ail opportunity for u^ing DIALOG to sdkrcb reference questions 
online. The problem here is' the cost. I do not foresee that we will be able to* do^ this 
in the near future. _ ^ ' 

' ' - ^ — Parker* 

ttttt^ ^ ' . 

DIALOG has \)^n ksed very little in answering reference questions originating within . 
^he library. There are many types of reference questions fdr whi-ch DIALOG is of no 
or Uttle hel^ti^e. trivia, legal, dyto repair). There is some money to impend on v 
computerized literature searching for in-^house reference qiiesti^s. Most of the ma- 
terials found in such a search would be unavailable at our library and would have to 
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a be gotten elsewhere/ Librarians are re^uotant^o suggest DIALOG as an alternative 
'^o a patron in the library searching for infdrm^ion.. Perhaps this is because/DIALOG 

is a fee service. Most of our online searches are initiated by patrons from outside 

the library who^know of the. service and isk for it specifically/ and not by librarians 
•forking pn in-house reference questions. There is a good potential for Using DIALOG 

^or such questions, but the lack of oioney ^appropriated for such a purpose is the key 

ni^gative factor. ^ 

' ^ ' -Johnson* 

. ■ . ftttt 

Data Bases . . 



"•^ We find-NTIS most valuable - it provides us with information that givps us goodieads 
to other sources. We have f^nd it a fast, efficient base to search, and we've had 
excellent results. We're gaining more expterience in CAIN.and^ike that base very 
much also. , ' 



.Psych Abstracts has also been invaluable. It is a -difficult base to searc^ manually 
and we can find a great deal of material online that wbuld not be cost effective to ob- 
, tain by manual search. We had never realized the wealth' of materia^ in Psych Abstracts 
until we used it in the online form. The Foundation data baseg have been pi great use 'to 
our Sociology Dep'artment which is a regional repositoy-y for these isaterTaTs^^s well as 
to INFORM. ' ' ' V . ' 

The one frustration we have had in using .the system is that«Fodd Technology Abstracts" 
is not online in DIALOG. It is something we use constantly and it is very cumbersome 
to use manually.* There are so many sross checks'^at have to be'dpne thkt we would 
really appreciate having online access. IF Food Technology Abstracts had been online 
we would have easii> doubled the numbei<of searches during the trial period. _ a- 

• . -Vantihe 
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DIALOG provides several filers which^are useful for urban research. . The ijiost per- 
tinent is probably JSITIS wjaich, with its strong base of government- sponi^red research,^ 
covers, many areas of interest to municipal managers. In recenjt months, for example, 
San Jose Municipal Refererice Library has conducted searches in NTIS for*city staff on 
such subjects as computer design o^ sewer systems, pedestrian safety, urban goods 
transportation, bus transportation, energy conservation ifrtuildings, and health needs 
assessment. The results of our searches in NTIS hav^en^raUy been very good, and- 
the flexibility of search techniques has greatly simplified access to that body of report 
literature. Other files," such as Compehdex or ABI, which focus on aertain aspects of 
public works, personnel management, administration, finance, and the like, are also 
valuable ^n supporting an urban affairs refei:ence service,.^ ^ • . - ' 

r * — Luchessi 

. ttttt^ ' % ^ ^ 
Our biggest problem is not having information aboutthe data bases. Data base^ have 
been added and we .have not received instructional material until several months after- 
ward. We have not hac^ specific training In the use of most data" bases. I^redicast^ * 
was on for a year before we leai^ed how io operate it. There are some new bases on- 
,line for which we may be using the wrong techniques because we are basing our approach 
on the brief blurb that was in the Chronolog. 

. ' — Doudeil 

' c ' ttttt - . • , ^ • 

Th^ number of data bases keeps expanding. There is no possj^itynpf part-timfe 
searchers mastering them all. There are many/ subject areas which, can be searched, 
but most of the searches done at this library are in either ERIC or Psych. Manjj of 
the data bases have never been searched, and may be searched very rarely in the 
future. Nevertheless, it is good to^ know they are there. 

^ Johnson* 

: , ' ^-z ttttt . , ' 

As has J5een the case ever since we started using DIALOG,, most of our searches hav^ 
been^'in E^IC due to the San Jose Stat§ University students. I would say that we <ise 
10 data bases 99% of the'time. It's nice to have the large number (now. up to 60) to 
choose from, but it will take more publicity before we would have customers for many 

^. • -McEwen* 
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I view DIALOG as a relevant ad jyhct to/good library service as it offers comprehensive,, 
and up-to-date cover^e in many necessary fieMs, Some bases "are a bit esoteric for 
' general public usage But their availability is a comfort. 

General problems regarding DIALOG I would like to see rectified are: (1) standardiza-; 

\ • ' • , ' ' ^ ^ ' /' 

tion of formats for bases since much time is sj^nl ^'figuring out"*how a nei^base wor|ra^ 

(by new base I mean one that I,{aave not previously used or one that I have Oseti infre-'^'^ 

quently and need refreslling before using again); ' (2) I feel that the addition of bases | 

more attuned to public library needs would be most useful, e.g.', the Wilsoir gubrica-| ^ 

*tions; (3) in view of the aforementioned (see num^r 1) it would be most helpful if i 

'»f^ee^' tiipe Were still available — even if on a very limited' basis'. - . 

It would be helpful if more thesauri were available for pre~search screening of subject 
areas. We are /breed to suppose that the client is a^^^j^or an e^^ert in the field(s) 
related to their particular searph. Usually- their input is*adequate to their needs but 
how often, we ask ourselves,' could a bett^ search have been conducted if a thesaurus 
were handily nearby, v ^.r^ 'f ^ . 

\ ^ - Smith* 



: V ' . ttttt. 

Presence of Patrons During Se^rcJh 

One point that should be em|)ltasized is the importance of performing searcHes with 
the patron in attejndance. From our experience it works much bett6r; one knows ex 
actly what the^patron wants. ' . ' - - 

— Kristof ferson 



' ' ttttt , ' ' ^ ,-^5 

I think that it is essential that the patron attend the sjRrch session*, l |;iad only one . 
search where the patron wasn't present, and I felt very uncomfortable performing tJv^ 
search. The sueciess of the"search is really dependent on the patron being there 't^^ 
negotiate search strategy when results are insufficient. . ' - v % 



' ttttt 



r 
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f Personally., I.prefer to have the patron present while^'conduetine his search, ff the 
' patron is present when the operator is online he ha&a much better idea t>f .how online'* 
seafclting works, and why he got the results that he did. Also, if snags develop during 
the online siearch, if the search strategy ip not gettingTthe desired results, the patron 
is"* there to help th^e^ operator decide whether, to drop the^earch or try a different ap- 
preach. The operator is not a subject spepalist, and may need 'guidance from a patron 
in ilfie middle of a search. Most of the searches where Hhe patron has been less satis- 
fied with the results were searches* done^ithout the patron being present, 

. ' ^ —Johnson* 

ttttt ' - ' ^ ' . ' - 

This is to be recommended. It is more satisfjang to the customejp^and certainly makes 
• it' easier on the operator. .If too many citations appear, the patron can- choose to^e 

all or sol^ie of them^ Jt keSps us from worrying about wl|ipther we are getting too'much 
; material for hmi o^ not enough. Besides, when, he is there and sees-how the combi- 
' nation? are put togetheri, he seems to get a better grasp of how DIALOG works than if 
w6 just hand him the search results* • . ' ^ 

• : -McEwen^ , ^ 

\ ' ^ ' 



LI^^^Js( 



Location of Terminal as Factor inSJse ' 

_ ^ 



We are one library in a group of 13 county libraries. Although we have sent these 
libraries promotional material, we have not 'been ^receiving many questions from them. 
Most people who have come in fo^ ^earches have contadted us directly or are .people ^ 
t^b regularly use our library. The fact that the computer terminal is npt physically 
•present at thejse other libraries seems to mak^ difference, ' - ^ 

. ^ . • '^-boudell 

' - ^ ^ * trttt . . ^ ^ c / 

I believe that the patyon is jnore attracted to online seardh if. the ter;ninal is located in 
^1 h^ local branJ^, We were surprised that when we mentioned,the gossibility of losing 
^he more expensive TWX for the third year, we hM some patrons who immediately 
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volunteered that they were willing to pay the extra cost rather than go to a more 
, distant, library. 

— Thomas 

mtt . ^ 

The location of the terminal has little ,effecK)n it^use. There have been hardly any 
searches generated bec^u^e a patron wandering through the library saw the terminal, 
read the signs and brochures, and decided this was exactly what he needed. The ma- 
jority of searches originate with people who already know the fibrarjifes this servic^e^ 
and call in to make an appointment . ^ " . 

' " r Joh[fe^Qji]J^ 

' ttttf 

Doesn^t appear to have any effect. The fact that it ^s in a publi/j area generates some 
^interest • but rarely does it bring us a new customer 
\ - ' ' , ^ ' . -McEwen* 

' ^ ^ ' ^ ^ . 'ttttt 

Use. of Offline Printing - " ' 

We rarely use oifflijie printing. We feel that the 3 or 4 days of waiting -for a printout 
is a det;riment for most of our questions. We use offline printing only when we h^e 
long-term projects or when the person indicated they really do-not have immediate 
. deadlines. Three or 4 days is too long if your are interested in a business question. 
^ The businessman generally waits too long to ask the question,^and he must have his 

^, answers as rapidly as possible. \^ ' 

^. ' * — ^Vantine 

-ttttt ' ^' . 

Reliability of Service • ' ' * * • 

Tyms^are and Telenet give us more reliability problems than DIALOG does. We have 
only been irrconveniehced once hy^ a DIALOG crash; the other times we have had a con- 
nection problem'. In general, we haveTiad very good 3ervicfe indeed. 

— Vantine 

, - ' • ' * i^tttt ' ^ ' ; 
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On the whole, ^the reliability of DIALOG service has been quite good/ But when the 
itfbmputer ^pes'go dowp, everything comes to a halt and this does create a problem. 
It is eiiibarilis'sing to sit down before the terminal with an eager pa^Cron, confidently, 
dial up the computer and not get^an answer because of some computer bug. Worse 
still is when an operator is in the middle of a complex search and the computer, goes^ 
down.' The operator has no idea how long it is going to be before the computer is fixed. 
Shtolild tlie operator encourage- the^ patron to wait a. few minutes, make another appoint- 
Iiient,. or offer to <Io the search himself later th^t day when the computer is back up but 
the patrdh has te^ff? The people at Lockheed are of little help, When called about the 
/length of the<lelay, they are often vagpe or overly optimistic. DIALOG is a marvelous 
-system, when it is worlcingf . ^ ^ 



Johnson* 



ttttt 



The>incidence of downtimejias been very smallTiyts year. Also, we have had a few 
bi^sy signals. All in all,-,servicc this year has been great. 

— McEwen* 

ttttt 



Importance of the^Seryice 



4 



Computerized literature searching is the move "of the future. J^r^ speed and^coi^re*- 
hensiveness,' it cannot be compared to manual literature seardiihg.^^ The future profn^ 
ises more data bases, and increased price competition between riyal^ataljase x§ndp©s. 
Online searching should be offered>£it all academic libraries. It(^'^^^d be offej^t at 
those public libraries whose administrators make a firm commitmeijf to^provi^^Sgde- 
quate staffing. To me, onlme searching has been both educational enjoyable, and 
I.hopefo continue to be involved with it. • - * ; * . x"** . 

' —Johnson* \ ' 

^ ' ttttt.. 
Libraries ai-e going to have to get into onlind search. The schools are producing 
machine-oriented individuals, and people are welF aware of how one can get at infor- 
mation through the use of the computer/^ There- are going to ^De.more and more people- 
"in the publit ^ho are not academically or business connected who are afteri^specialized 
information that they expect to'get' from libraries^ * • . » ' 
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In summar3^i th^ onlin^terminal was a Jnucii%preciated service. In' the near future* , 
it will;neces^arily be more or less s61f-^su^portihg; weiope that we can draw together 
some stati^ioiiihat will help make "thfs possible. ' x ' ' ]' ' 

-^Thomas . . 

. ..- ttttt ' " .■•*■■ 

I would like to enlphatically state that DIALOG, "while, it has its peculiarities -and 
problems, is a positive approach and a most welcome addition to libraries. ' 

B,2. 6 Need for I^ifblicity to^^pi^qinote Use of Online Search 
Publicity to Library Staff -'S"^^'^-^:^ 

It la important to Q^tablish ^base of support within the library by running, training ■ . 
sessions for libi:arians:\^^ho might forward questions to the search center. It is im- ^ 
.portant that staff members not f^el left out. They shoul^ n6t regard the online search 
system as a special' ttjol-closed to them, but as something that ha3 practical applica- 
tion for every reference librarian. * , 

^ We had ,io or, 12 introductory sessions'for stMf members of any level who were 
inter^^tJg'd, fi^om the janitors right up to the director. We had a total of 60 or 70 
•people who, attended, out of a staff of 220. I explained the online system to them anc^ 
how it is u^ed, and we ran demonstration searches. ' iach department was asked if 
there was 'a professional staff member who was-'iiitereSted in online searching. About 
12 libraxi^ wete then trained more intensively on how one sets up a search strategy 
aiid^we^l^ven time to practice on the terminal. ;,gome,of these'pers.ons have practiced 
anU.s ems' have not. . . >- ' v , .-\ , • 



ttttt 



^ - Vantine 

w 
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Publicity to patrons is more important than publicity to library staff on other libraries. 
Library staff ^should be familiar with the service, but main publicity 'effort should go 
' toward introducin'g library pat;»Qns to the new. service. 

I ^ * ' ^ , — Kendig* ' 

Regarding guideline's for public libraries^considering online service, I would empha- 
. size making librarians familiar and comfortable with the service through demonstra- 
. tions in small groups and in familiar subject areas. Oncfe^ttie librarians are enthusi- 
astic (as most of them arje after having s§en successful demonstrations), likely search 

topics seem to flow in. . { ' * 

» 

j y . - Neuf eld 

' - 'nttt 

It should be pointed out that all of the staff menjbers here have enough knowledge of , 
^ online search to be able to an^er patron que'^tions about the system wheii the search 
staff is not available. • t* ^ 

) . • ^ ' 

— Kristofferson 

^ • ( ^ 

ttttf 

Publicity to- Other Libraries ^ ' ' » 

Branch librarians will also remain a prob'Jeiji lorever more. They don't care enou^ 
to spend the time to learn enough to take the initiative in generating online search 
^requests and will have to be relied on m'erely ^s a pipeline for users who have already 
^ decided thkt they,want DIALOG searches, Thfey simply have too many other things to 
- worry about; DIAJ.OG is too low a priqrity' Most, howeveor, are willing to fepay a 
request, now that they have tried it a few times and no one has bitten them. 

. - . ; / -DeWath' 
. . ^ • tttft- 

It may be that we should provide niore information to the librarians in these other 
libraries so that they will have a better idea of wh^t online search is and what it can * 
supply. Although I don't operate the terminal, -the little knowledge that I have is im- 
portant in that it helps me answer questions abput online search when I am at-the 
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-reference desk. Those who are not familiar with online search canliave an erroneous 
idea of what the true capabilities of the system are with resp6ct to a given question. 

-Thompson 

- • \ ttttt. 
,We feel that the time was not sufficient to make all librarians aware of the ways in 
which the program could be of service to th^m and to their users. We ^jave not yet 
succeeded in reaching the-eptire potential clientele but think we w^l in timei I think, 
the committee and the board are convinced the service is worthwhile^ .More spade- 
work has to be done to remove objections of librarians to charging for services, and 
hesitation to suggest methods with which they are not familfkr, but this^too is easing 
with time* 



- Neufeld 



ttttt 

Besides the newspaper article, we have done no outside publicizing of the online ser- 
vice other than at meetings such as the local SLA chapter, the American Xaw Librar- 
ians Association,* and an American Marketing Association seminar on information 

' retrieval. , We have also discussed the service with librarians throughout this region. 
We try to make users aware that online service is necessary if you g:re really going to 

t do a good job for most business and technical questions. 

— Vantine 



ttttt 



1 



Publicity to Patrons and the Community 



. We have not used handouts or other printed material for the public. Ho^Vever, we 
, have taken the opportunity, whenever possible, of performing demonstrations for 
business people. When we receive an inquiry from corporations concerning the sys- 
tern, we try to arrange for a demonstration. There has been an_.increasing and con- 
' tinuing interest in what is a:vairable'<^irie.." If we feel that an online search is relevant 
^to a question, then we mention this to the client indicating the possible results of the 
-search and the possible, cost. In nine times out qf ten, the client is interested in the' 
computer search. ^ " * " . * - * * 



— Yantine 



12'6 



ttttt 
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We had discouraged publicity because we didn't have the staff to handle more questions, 

but publicity is a chicken-and-egg situation: if you 4on!t have the support for the staff, 

you^an't publicize the service; but if you don't publicize the service, you don't get the 

^^emand and you can't get support for the staff. We may have to go through a\ad period 

of pu^hing the service, contracting business, technical, and professional groJps in 

order to b]5ild usage. Then, w,e can attempt to cliarge a fee t6 cover staff time. We ^ 

have not publicized the way Redwood City'has, and. still the word has spread. About 

50% of our searches are for business clientele, but ther^is going to have to be a lot^ 

more' publicity if we want to promotq. DIALQG to reach all potential users. 
^ < • * • * , 

^ —'/homas . 
* ^ * ttttt' ' ^ ' • 

Publicity will remain a problem forever more. Most people don't need online searchW * 
frequently endugh to qualify as repeat users. We'll always be trying to find and sell 
'new users. Fewer users (fewer than during the free period) mean less^word-of -mouth 
^ publicity, which still accounts for most of our business, j ' * - 

- ^ . . . , -DeWath 

... ^ Vtttt ' 

We have some patrons who are computer experts who know exactly how the system will 
work and w^iat they \vant when they come in.. We have the opposite extreme of people, 
wh^^ow nothing about computers and who are unsure as to how to express their 
requirements. We therefore spend, a lot of time explaining how online search works 
^ \^ ;and what is required, and we m^ke this explanation over and over again.^ The exam- 
pies in our handouts have not been thorough' enough to give patrons an idea of what the 
steps are in fprmulating^ search strategy. It would be nice if- they could look at some- 
. • * thing before they com6 in. Usually we must pull out a search that we have already 
done to show them how -the system works. Many times they still don't understand, 
making it difficult to produce a satisfactory search. 

. • ' ' ' ^ - Ddudell 

ttttt ^ 
There is no, question that increased pttblicity would result in increased demands for • 
Dj[AJL,OG service. Soriie publicity Vas generated for the system when it was inaugurated, 
but now searcheg are the result' of information spread by word^-of -mouth or by college 

V • , / ^ • ' • B-43 , 
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instructors to students. If a concerted effort were made to publicize the service among 
the business, .scientific, and academic communities, the number .of monthly searches 
could easily be doybled. But it is doubtful, our staff could handle so heavy a DIALOG 
workload. That is why the staff has mad^ no effort to spread the word -about DIALOG. 
Our staff can barely manage the num^ber (k searches we are doing now without benefit 



of publicity. 



Y ' , —Johnson* 

\ TttTT • ' 



B.2. 7 Wljo Are the«ers (and Nonusers)? 

The usfers of DIALOG by this library (San Jose) are primarily students, with lesser , 
usage b^^ business and scientific/technical professionals. The number of ^dents 
users is not surprising since the library is only four blocks from a large/state univer-' 
sity. It is common practice' for some professors to tell their student^ to come here to 
do a computerized literature ^arch for their thesis or term paper. Those who are not 
using the service are the traditional public library patrons. Thesfe people need infor- \ 
matron of a more general nature than can be found in DIALOG*. The information \ 
in DIALOG is just too esoteric. If there Were a data base equivalent to Reader's 

Guide available at reasonable cost, the average public library patron would find online 

. I 1 ^ ^ 

literature searching more attractive. ' . ^ ^ . ' 

. , ' ^ ^ —Johnson* 

\ ■ ^ > ttjTT ^ . ; " 

The response from users has been favorable, that is, from those who have actually 
used it, but the majority of our users aren't interested. By favorable^ however, I 
mean less than overwhelming -^the world is not beating a path to our door. No doubt 
^as more data bases are added DIALOG will appeal to more people, but it will still ap- 
peal mainly to scholars and researchers, and to^e'ople whose businesses are directly 
related to, subjects covered by DIALOG. These aye not the people who form the back- 
bone of the public library, much as we like to believe that they are 7 few scholars^and 
researchers think. of the'public library as a resource. We would like'to change that, 
and DIALOG j2f^rhelp 'US change that, but itjs a long, slow change. 

• ' ' ' -DeWath 

. ttttt * • " - ■ 
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We have v^ked with the Municipal Information Library to answer questions posed by 
the*mayor and other city officials. There is active support 'from our city officials, 
^hey are aware that a tool is available to locate important information for their needs 
in a short time. 

/ ^ — Vantine • ' 

. ^ ^^^^^ ■ y - 

There mit^e 'more Referral from branches than we realise, since some of the patrons 
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who call us (^^rectly may have been directed to us by their branch libral^es. ^ 

Thomas 

* ^ ' {Ttttt • ^ ^v* • * ' 

Our County Librarian, Barbara Campbell/, felt that it was important to provide free 
search for the county departments since they provide) certain services to us. We were 
disappointed in the degree of county interest. 'Only/fhe Planning and Public Works 
Departments came to our demonstrations; there are still many department's that ap- 
parently have not discovered what we can provide through online search. Nevertheless, 
we have done a fair number of searches for Planning and Public^ Works and algo for 
the Health Department . * ' 
N * ' * ^ * - - — Thomas . . 

We wei>t to the, County offices and g&ve a number of demonstrations. We haven Vt 
charged the County departments for any of the'sear^hes that we have run. However, 
we have not received the responfee that we thought we would have. We had looked to 
the County as one outside source of demand in the future, and we had thought that a , 
demand would develop and that they might help with some funding in the future. This 
was a big disappointment to us-. - ' . • . , . 

, ^ .1/ Holtby . ^ 

ttttt 

In nay jexperience, users of the service are generally students working toward their 
niasters or doctorates, or members of the -business conununity who are having 
searches performed for work related purposes. 

^ *^ —Parker* 

ttftt ; > ^ 
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At the end Of the^ third year, I noticed that our library was getting a ffm/ more calls 
frcttn membOrs of the corporate community in our service are^a and fewer fipom outside 
theXIN network! * ' - ; . . 

^. • , • ^ - ]V£cNabb'*'^' 

. ^ ' ' . ttttt - ' ^ ' 

B,2.8 Other Topics . ^- • , ^ . 

Use of a Portable and TWX Terminal . • * 

We were fortunate to have available a portable Texas Instruments terminabfor the 
3-year period. Although one reason for our participation in the DIALIB project was 
the use of TWX J we did not make too much use of this during the first year, very * 
. limited- use during the second, and somewhat more frequent use during the third. With 
^ the portable terminal, we were able to/vigit 12 of the 14 Branch Libraries of San Matep 
County Library and 6 of the 8 Public l/ibraries in the Peninsula Library System and 
give demonstrations.- Demonstrations were given for County Government offipes'such 
as County Managers Office, Pi^c Works, Planning, Agriculture, and Public Health 
and Welfare • The demonstrations with the publicity were thought to t)e,;a>vbasisior 
attracting users; however, " it did not work tms way, as only a few r^qtrests were gen^- 
erated as^ a result of either. The exception was in the Public Health and Welfare 
Department; since there appeared to be a continuing lise pattern, the department 
librarian received training and conducted iki^ department's searches. We fou^ using 
the portable terminal with County telephone tielines (it was a local call/roni J^edwood 
City) frequently resulted in garbled page copy on the teri&in^l; this made it difficult to 
read as weU as to concentrate on ^^&-^e'arch pattern. During the third year, more use 
was made not of the TWX/but,of the microwave teletype and telephone line's dedicated, 
to conaputer use. /The^iffe^eijce in speed. was noticeable* from 30 CPS to 10 C:pS, but 
no garbling wa^ noted; since the teletype was equipped with a tape attachment,^ tape 
cojvy of the search could be made and retransmitted to a Branch. Library; this was done 
in several' rush requests so the patron would know what to* expect. Wlien we were 
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considering the TWX as the mcians of access, it was determined .the charge would be 

15^ per minute; this charge wotild have to be added to cost of search to the patron; 

the library didmake provision for covering the cost of TWX charges for .the free and 

half-fee period, but during the full-fee period, the cost of TWX is added to patron 

charges. During the second year, 18 searches were made on TWX and 8 on the tele- 

tjTDewriter; the log for the third year does not indicate the number of searches done 

' - ' * *' ^ I ~~ 

by teletypewriter. The use of the terming^l was the option to reduce costs to the ' 

patron for search time. However, from the. end of the third year, all^the searches 

will be done on the TT . * ^ * * . . ; 



- Scott* 



tTttt 



Mail Requests 'for Service ^ 

DIALOG requests were also facilitated by doing the entire transaction by mail. San 
Mateo County Library did this to, a certain extent with/requests from Stanislaus State 
and also from our branches (by a regular delivery service within our library system). 
After discussing' with the patron. the cost of service, Vhat results could be expected^ 
etc, , form^^were mailed to the pjltron, YfllecJ out by patron, &nd returned with the de- 
posit. Requests were done as soon as possible an5 results mailed to patron.^ Another 
benefit of the mail transaction, was the convenience/to both partiefe and I believe it was 
more cost effective for the patron. It also gave the librarian a better opportunity to v 
prepare search strategy-^ because a problem still \yith the DIALOG system'^was the in- 
creasing number of d^ta ba^es added one right after the other, and in this period of 
time, with only 1 hour of demonstration time ainonth, there was very little online^ 
learning of idiosyncrasies of individual data bases. ' * • ; " ' 



) or mdi 



- McNabb* 



J 
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C. 1 SAN MATEO COUNTY LIBRARY (3>YEAR PARTICIPATION) 

• . r 

• James Buckley, County Librarian 

• Anna Scott, Reference Coordinator 

• Nancy Lewis., Reference/Documents Librarian (transferrefi to another 
Division 5/75) 

* • Beth McNabb, Reference Librarian - 

^ • Joan P. Tobias, Reference/Documents Librarian (from 9/75 to date) 

• , Nancy DeWath, Reference Librarian (left project 5/76) 

• Wayne Smith, Reference 'Librarian * , 

• Nancy Crabbe, San Mateo County Dept of Public Health & Welfare LiJ)rarian 

• -Evelyn Helmer, Public Information Coordinator 

• Dennis Nolan, Staff Artist ^ . 

, /\ ' » 

W. Buckley gave his apprVal for pur participation and encouraged' usage and demon 
strations for County^ Branch Libraries , Peninsula Library Systein Libraries , and for 
Co.unty Government departments. 

0 - ' * 

Ann Scott, Nancy Lewis , Nancy DdWath, and Beth McNabb were the first trained 

»■ 

operators. Nancy DeWath did most of the work in developing forms , logs , and 
initial training of staff. AH these reference-librarians participated in demonstra- 
tions in libraries , at orgaiii^tional meetings , and in County departments'. * Wayne 
Smith was the last librarian to r^eive training in the group^ of librariaijs on the staff 
at the beginning of the project. • * . 

Joan Tobias received the training after she reported to. the Reference Division and 
has been a^Dialog researcher ever since; she^mpleted the Predicast special train- 
ing course in December 1975. . ^ ■ 

• Nancy Crabbe, librarian for a departmental library., was'^ained in DIALOG iecause 
she was a heavy user and'this reduced the workload on the County Library Reference 
Staff. ' ' .. * ' - ■ 

"f33 
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Evelyn Helmer is the San Mateo County Library Public Inforni^iion Coordinator and 
kept up a flow of publicity for San Mateo tJounty Library. DenMs Nolan, staff artist, 
contributed ideas for local displays and publicity brochures which serve to attract 
attention. • . ~ V 

AH the people listed contributed time and effturt in supportl^of the project as well as 
the remainder of the Reference Division sta|f who had to tjover while the Reference 
Librarianar were at training sessions and, demonstrations. 



» Anna M: Scott ~, 
Reference Coordinator 



C.2 REDWOOD CITY PUBLIC LIBI^^Y (2-YEAR PARTICIPATION) 



First^earr- Sally brew, Librarian HI - * 

Thomas Kam, Librarian EE 
'-^ . • ^ 

Dolores King , -Librarian I 
Alice Tabarif Librarian I 
Lucile Beifedetti, Librarian I 

- V , . , ;• ■ ■ , 

Second Year: . Lisa H. Naef , Librarian m ^' ^ 

Thomas Kam , Librarian n 

Lucile Benedetti > Librarian E . ^. . • . ' 

^usan Kaplan , Librarian I ^ 

Linda Linde en, Librarian I ' , " » . 

Each of these persons acted as interviewer, search operatot, and did the followup 
work with Dialog users,. 
.In addition the Librarians HI coordinated assignments, kept the account books, and 
made reports. . '/ , . 



Lisa H. Naef 

Head r Adult Referenpe and Readers' 
Advisory Services 
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C . 3 SAN JQSE PUBLIC LIBRARY ( 3-YEAR;'PARTICIPATI0N ) " . • 

• Beverly ChancerOffic^Supervisor, handled4?IALOG tavoice/billing 

• 'Rose Cyimi, Administrative Services Officer,, established administrative 

• procedure involving DIALOG ' , • . . 

• Homer Fletcher, City Librarian, approved and supported DIALOG 

• Bob JohnsoA, Reference Librarian, DIALOG operator- ^ 

• Robin Kendig, Municipal Reference Librarian, DIALOG operator (3rd year) 
•I Char^een Kurotsuchi, Reference Librarian, DIALOG operator and DIALIB 

liaison • . . 

• • • Rob Luchessi; Reference-Librarian, DIALOG operator 
. • Scotty McEwen, Reference Librarian, DIALOG operator i . 

• Richard Rendler, Chief, 'Public Service, administrative liaison 

• Charlotte Sakai, Reference Librarian, DIALOG operator and DIALIB 
k liaison .^^^^ ■ 

• Phyllis Parker, Branch 'Lj^isonLibrari^, DIALOG operatorU^rd year) 

' • Katherine Devonshire, Typist Clerk, hanied DIALOG printouts and statistics 

• Dorotha Edwards, Typist Clerk, handled DIALtXJ printouts and statistics 




Charlotte. Sakai • ^ 
DIALIB Liaison 

C 4 SANTA CLARA CoSfeTyXiBRARY (CUPERTINO) (2 -YEAR PARTICIPATION) 

Credits are due to: ^ • ^ . ^ " • 

'Barbara"^ampbeU , Santa Clara Cou^y Librarian, for her agreement to allow partici- 
pation in the NSf Study , .providii^ space and allowing staff time as needed for planning 
meetings . reports . workshops, and DIALOG demonstrations and searches as required 
threughout the:Project, and for her enthusiastic support of the -investigation of a new 
dimeneipn in library service. ... ' > ^'" '^ 

Phyllis Levine , Supervisor of Adult Services, Santa Clara 'Gounty Library, 'for her 
participation, in tlie organizing and planning of the project^ as it operated 16 the 
Cupertino Libra:t:y ,ajid elsewhere. % o 
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Lois Thomas , Reference Librarian, Santa Clara County Library, who, as head of 

». . - * , 1^ 

the Research Center, managed the DIALOG program* at Cupertin6 Library, 

Allison Holtby , who has'been^Chief Reporter for the Cupertino operation as well as 
a DIALOG demonstrator and searcher ; and whose ideas as well as time and effort 
ccmtributed much to the program. , " ^ ^ ^ 

Charlotte Doudell , whose skill and previous knowledge of machine searching addfed a 
great plus to the project at Cupertino. 

^ Eric Kristofferson ^ whose scientific background coupled .with knowledge of automated 
retrieval systems promoted jsl high degred of expertise in the Cupertino program, 

DalQ /thofapson , \vho, as Regional Librarian in chaarge oif Cupertino^ Library , has 
constantly top^d with adjusting schedules and workloads; to permit DIALOG to operate 
smoothly for the^benefit of patrons and the project. 



Cheyyl Mouton , now with Richmond Public Library, who enthusiastically participated 
in the early stages of the prograih at Cupertino, giving demonstrations and conducting 
searches.. ; ^ *. ' 

M^ry Ferber , now Qrcfer Librarian for Santa Clara County, whd devoted time and 
enargy to the Cupertino progj^am in the first*months of the project, giving demon- 
strations and conducting seai^ches. ^ ^ 



Lois Thomas 

Head, Research Center ^ 



C.5 MINNEAPOLIS PUBLIC LIBRARY (INFORM) (6-MONTH PARTICIPATION) ' ' 

i J ^ 

• Joseph kimbrough, Director • . , 

. • Capi^L. Vantine-INFORM Librarian ^ . ' ^ 

Carol A. Helsing-INFORM Librarian (now with 3M Business Iriformatjlon . 
Service) . ^ . - . -> ' s . ^ 

• Amy Raedeke-INFORM Librarian 
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C.6 CLEVELAND PtTBUlC LIBRARY (FACTS TOR AyFEE) (6^M0NTH ^^TICIPATION) 

J • Ervin J. Gaines, Director ' ^ ^ " - 

^ • Ethel Jsi.^ Robinson, Head of Maiii%jibrary v' * ' 

* » • Jean Davenport, Facts for a Fee Consultant ^ - 

• C.7 HOUSTON PUBLIC LIBRARY (6-MONTH PARTICIPATION) ^ 

• David MV Hen ington. Director 

• Ann Landtroop, Head, Business, Science and Technology ^ 

C,8 LONG .ISLAND LIBRARY RESOURCES COUNCIL (6-MONTH PARTICIPATION) 



• David Wilder, Director . ^ ^ 
Judith B. Neufeld, Assistant to the Director 

' • C.9 TULSA CITY-COUNTY LIBRARY (INFO E) (3RD-YEAR PARTICIPATION)- 

. • Xiinda Hill, Head, Business and Technology Department 

• Jane Colwin, INFO n Research Librarian 
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The publicity*approach followed a four-stage approach, as descr|||||j|by our publicity 
consultant, Evelyn Helmer. * ^ , • . . * 

» • Stage One; . ^ * ^ ' * 

Ribbon cutting ceremoliies took place in the San Jose Public Library; news 
Stories appeared in four daily newspapers and half dozen local weeklies (see , 
Fig, Q-l); there, was some coverage on the news program^ of local radio 
' stations and one TV network covered the opening ceremonies. Brochures, 
. , -bookmarks, and posters were deigned primarily for distribution to public, 

school, special, industrial, and -college libraries infanta Clara and San Mateo^^^ 
Counties. Ultimately they included also Monterey and Santa Cruz Coimties 
when they joined the Cooperative' Information Network. TJiese materials were 
^^>ued from time to time when opportunities for wider distribution were 
, ^ sought, i.^e. , at state and national library conventions, professional confer- 

ences, and meetings of technical and scientific organizations. It soon became 
• appare^it that publicity of a general nature needed to be supplemented by more • 
^ ^ specific descriptive flyers and b1:ochures. <See Figs\ D-2, D-3.) * ' . 

• StagfeTwo: «.. . * 

During this period, several hundred brocKures and cover letters were mailed * 
to scientific, technical, educaticmal,, and prof ess^ionaLorgaehizations, as well 
as to schools, a few businesses,' governmental departments primarily in 
the Santa Clara and San Majteo County and City jujMs'dfctions. Invitations 
were sent to various groups encouraging them to ask for demonstrations. 
' ' Reference librarians did on-the-^spot^seatclies for nearly two dozen groups" 

as varied as the Coroner's' Department, Kiwanis Club^ and County Manager's 
Office, ' ^ * • ' 

• ■ . ' . ■ . - ■ J ■ , 

/ * ^ ' Perhaps the most difficult problem at this time was'gauging the amount-of • , 

- publicity tha^should be< released. Everyone *wanted the project to succeed , 
• * ' ■ / ■ - . 

*lt has been a chail6n|e and an' interesting two ye^ sei^ving th^ project as publicity 
coordinator. I am gratefiU for all the help given to me in my efforts to spread the \ 
word. Special thanks to OscanFirscfieiii, Ann ScQtt, Nancy.DeWath, Beth McNabb, 
.'Salleyj Drew, Li^a^Naef, Lois Thpttias, Charlbtte Sakai, and staff artist, Dennis Nolan. 
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Conversation With a Computer 



Behind every* successful 
transaction with a computer is 
a human being. 

And the person behind the' 
County Library System's new 
research computer operattui 
Xancy Dewath, research 
librarian,*and her co-workers ^ 

The recently-installed" 
computerized program at the 
centi;al library on Tower 
Road, Belmont, provides 
almost instantaneous in- ^ 
formation on rest)urce ' 
material,* information that 
until now has taken days, even 
weeks of research. 

But the duration of those' 
mstants depends on the 
librarians in individual 
libraries that are tied into the 
Systenr, and on the operator of 
the terminal, which resembles 
a typewriter 

Tliey must be detectives, 
psychologists, linguists, 
researchers and just plain 
good gu^sers 

The process starts at the^ 
local library, where the 
patron tells the librarian the 
subject of the desired in- 
formation 

Oi.c word, however, isn't 
enough information for the 
computer appropriately 
ni.med "Dialog", which lives 
at Lockheed in Sunnyvale, Jo 
provide the specific in- 
forma:tion wanted- 

The researcher is carefully 
questioned to elicit k^y words 
that will point the computer in 
the exact direction. 
*iThen -the information is 
transmitted by telephone or 
teletype to the Tower Road 
library » 

There, the librarian dials a 
telephone number which is 
answered, so to speak, by the 
computer The operator gives 
' a password to reassure the 
coKOpuler that no outsider is 
trying to steal inforination 
That's when it begins to get 
interesting 
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KKSKAIICII LIBKAKIAN Nancy Dewath aids research worker track down materials 
checks replies frofn computer at j^kheed Jor a project. 
Missiles and Spaci^-Co. In Sunnyvale as she * 

The ^:ompuler has stored in reference^ desired must be « a game. ^ 
It- six million citations, and elicited. ' • The subject is first divided 

from nhese the precise ^t can become something of ~ \McofitinuedonPage4) 



Fig. D-1 Typical Newspaper Coverage of the P 
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REDWOOD CITY PUBLIC LIBRARY ^ 
881 Jefferson Avenue. RedwcxKl City 

^(415) 369-3737 
Library Hours: 
Monday-Friday 9:00 • 9:00 p,m, 
Saturday 9:00 - 6:00 p,m. 

^ SANTA CLARA COUNTY LIBRARY 

RESEARCH QENTER ' 
, 10400 Torre Avenue, Cupertino 

(408) 253-6212 
Library Hours: 

^onday-Frlday 9:00 • 9:00 p-m. 
Saturday 9:00 - 6:00 p.m, 

SAN JOSE PUBLIC. LIBRARY 
180 West San Carlos Street, San Jose 

• (408) 287-2788 Ext. 4855, 4858 
Library Hours: 

Monday 12:00 - 9:00 p.m. 

T., W.. Tht 9:00 - 9:00 p.m. 

FrL. Sat. 9:00 - 6:00 p.m. 

SAN MATEO COUNTY LIBRARY 
TiEADQUARTERS 
25 Tower Road, -Belmont 
(415)573-205^ > 
Library Hours: ^ 
Monday-Friday 8:00 - 5:00 p.m. 



r An experimental project by 
, LOCKHEED INFORMATION SYSTEMS 
and 

COOPERATIVE INFORMATION 

NETWORK t 

funded by 

The National Science Foundation 





Fig, D-2 Sample Brochure 
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Are you writing a 'paper on 
microbiology, linguistics or cat 
leukemia? 



Do you administer an air conditioning 
and heating business? « 



Teaching a class of hyperkinetic 
children? 



Interested' In community services? 

Perhaps you are writing a boo^ : 
you've got a plot and the setting— now 
you need to enrich it with background 
data. 
> 

How about bee cglture or plant 
nutrients? 



^Oo you need to know more about 
tnan^jgement by objectives, 
Affirmative action programs, the' 
fQUr-^^^0 hour work week?" 

'.'Are you inv^lvedln yourcommunit/s 
' environitj^tal Impact studies? " 



i j^^gan find the current technical and 
•v,sg|||ntlflc informatlpn you needr as'' f 
as data from the fields of 
education, psychology, agriculture,.'" 
atid^he social sciendss.* - ^ 
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Fig, D-2r Sample Brochure (Cent. ) 



How may YOU obtain this 
Information? ^ 



an on-line information 
retrieval system, developed by 
Lockheed Information System,..was 
made available to the libraries of 
Ihe Cooperative Information * 
Network (CIN) by a grant from the 
'National Science Foundation. 



The computer service provides 
^ulck access to millions of - 
references in science,' technology, 
social sciences, (Psychology, 
education, and agriculture. 



Although the computer terminals 
are located in just four public 
libraries In Santa Clara and San 
^ Maleo counties, the patrons of all 
the libraries In the Cooperative 
Information Network may receive 
the .overwhelming amount of 0 
Information that can b^ read and 
brought forth by the computer 



During the first year.bf the program, 
there will be no charge to the 
library patron; however, there vyill 
be a nominal charge after June 1, ^ 
1975.^. / 



Ask your local librarian about D/flLQD 
or visit one of the libraries that has 
' a computer terminal. See locations 
on the back. 



.LMSC-D560&86. 
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developed by the Lockheed \ » 
Information Systems, is avalia* 
ble to the Cooperative informa* 
tion Network (CiN) Libraries^ ^ « >^ 

Made^ possible iby a granf from 
the National Science Founda* ' 
tion, this servfce provides quick 
access to millions of references 
in science, technology, social 
science's, psychology, educa- 
tion, and agriculture. . ' ' ' 

Ask your local librarian about the 
servlpes of DJHLQG ^ or visit 
one of the' libraries that has a 
computer terminal. 

REDWOOD CITY PUBLIC ' ^ " 
LIBRARY ^ 
881 Jefferson Avenue . 
Redwood City (415) 369-3737 ^ 
Library Hours: 

i M-F 9:00-9:00 p.m. 

Saturday 9:00-6:00 p.m.' 

^ SANTA CLARA COUNTY 
LIBRARY RESEARCH CENTER 

(Cupertino) ^ ^ 

10400 Torre Avenue 
Cupertino ' (408) 253-6212 
Librar^liours: 
M-F ' ^:00-9:00 p.m, 

Saturday 9:00-6:00 p.m. 

' SAN^fclOSE PUBLIC LIBRARY 
180 West San Carlos Street ' 
^ San Uose - (408) 287-2788r 

^ ^xtJ8S5, 4858 ^ . 

^Library Hours: ^ f V 

O^onday*, 12:00-9:00 p.m. 
* T. % Th. - 9:00-9:00 p.m. ' 
Frl^t.. 9:00-6:00 p.m.- , 

S/\|^,MATED COUNTY ' 
lliRARy HEADQUARTERS 
I ^ 2!5 Tower Road 
4 Belmont , * ^ (415) 573-2071 
Library Hours: 

:M-F ^' % 8:00-5:00 p.n). 
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b. ,Back 
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and the requests to come in, but libraries were fearful of "a flood .of requests 
that would tax staff members \vh"o were already working at capacity. Efforts 
were made to ascertain the effects of each publicity release an(/th^ subsequent^ 
actions were tailored to fit thd response ^vhen^ve'r possible. Although thej^fe i 
was never an overwhelming surge of interest from the public, all libraries^ 
felt they were repeiving about as much demand as they could handle without 
extra staff help; We did not, therefore, step up the. tempo of ^blicity, but 
rather kept a steady flow gping out to the community — another newspaper* 
article, a few radio spots-, and some mailii^s to business. 

Stage Three : . ^ ^ ' # 

This section of the plan was to have consisted of feature articles as follow up 
hnd major media presentations, on TvJ, perhaps. This did not materialize- 
because there was concerri^at Bay Area wide public ity^ might result'in a 
fall-out upon nonpartiaipating libraries unable to cope with the inquiries. 
However, a slide/tape presentation was produced that was used by some ^ 
libraries and schools both* as publicity for the project and staff orientation. . 
The tape is 11 minutes in length and there are §0 slides.*- Ads were placed in 
the Redwood City Tribime on four separate days. They produced 'only two ^ ' 
Inquiries. No searches resulted. • ' 

Stage Four : # . ^ . ^ ' / ' . " "'"^^ 

Instead of wide-spl'ead media coverage, we concentrated on pfosters with 

tear-off sheets for further information. We are still receiving a steady 

trickle of response from these, whereas the^^rect mailings elicited very 

little action: One direct, concentrated, and selegtvmailing'was directed at^^ 

ai) lippter middle class, primarily professional*commimity of Ladera, located 

near Stanford. The community consists of more than 400 families.. Materials 

were, mailed to about 200 households to determine the response. Since only ^ 

three individuals contacted the- libraries for further information, we did not 

continue with the additional 200 mailings. Finally, mailings were sent to 

Santa Clara Coimty government employees at th^ request of the Santa Clara 

County Library, which- made DIALCX5 parches available free erf charge to 

Cpunty officials. ^ 146 . ^ \^ 
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DIAiOG SYSTEM 



DIAIOG INTERACTIVE INFORMATION 



RETRIEVAL SYSTEM 



DIALOG is the name given to an interactive, computer-based information re- 
trieval language developed at the Wckheed Palo Ako Res^ear^h Laboratory, The 
DIALOG system Consists of a series of computer prograjps which have been ^de- 
signed to make full use of direct access memory. deviceslfm j^xch data located 
anywh^e on the device can be accessed in approximately tlib same amount of 
time) and- video display units to provide the user a rapid and powerful means of 
identifying records within a file whicft satisfy a particular>; information need. By 
providing the user full di^lay access to the indexing ^^abtiUry, g^d the ability to 
modify search expressions, DIALOG becomes a dairprocessing extension of'^the 
human operator who directs and controls the process according to hjs own personal 
needs. Figure 1 shows a DIALOG communications terminal which enables the user 
to communicate with the compater. The user issues commands to the^computer by 
way of the keyboard, and he receives results on* the display .%it- and/or on ^ 
teletype a^ appropriate. DIALOG allows the user with .a well-defined search-topic tp 
proceed directly to desired records: the user who cannot so explicitly define -his 
requirement is provided tools for browsing through the file. It ls.;thu35 possible to 
investigate successive avenues* of interest as they arise or are suggested by inter- 
mediate retrieval results. ; - v * 
The language procedures are easily learned, and the system has^ .tfeen used 






RfGURE 1. DIALOG communicathns' terminal. 
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DIJ^LOG SYSTEM * 

7 ' ^ ^" ' ' 

successfully by educators,* working scientists, engineers, and librarians. To under- ^ 

stand how such an information fetxieval system operates, one should be aware df 
historical solutions to the problem of infon^ation retrieval and should have a 
general grasp of the techniques employe^ within a computer to accomplish on-line 
retrieval of information. 

The central problem in information j-etrieval is to identify and obtain those docu- 
ments from a collection that contain desired information. The magnitude of the 
problem becomes apparent when it is realized that many current technical coltec- - 
tions require several miles of shelf space for storage. The user attempting to identify 
all documents that might discuss welding defects in 'aluminum or the use of molyb- 
denum disulfide as a solid lubricant in spacecraft, for example, f aces ^an almost - 
insurmoimtable information retrieval problem. * 

Theiiistorical solution to this^roblcm has been to create an index to the informa- 
tVon collection. Indexes can take many forms. Back-of-the-book indexes assist' the ^ 
reader in finding which pages of a book discuss a particular, topic. Library card 
catalogs are indexes that enable the lijjj-ary user to find information through several 
access points: subject, author, corporate .sq,urce, report number, and ofher collective 
characteristics. Although useful, manual indexes are limited in several ways. The 
more specific the indexing, the larger the index becomes, and the harder it is to find 
particular topics of fntercst in tl^e index. Consequently, manual indexes usualfy con- ^ 
tain Qnly relatively general subject headings which apply to large numbers of docu- 
njents. As a result, after finding a geileral topic of interest, the user still must scan . ^ ^ 
a sometimes burdensome amount of material to identify specific items of interest/ 
• Another limitatron inherent in manual indexes is the inability to combine or co- 
ordinate index elements Htlfo'comprehensive 'groups. If one ^jf'ishes to find what ^ - 
Stanfprd University has produced on the subject of leaching mathematics in the 
elementary grades, for example, thfe user has no way of con;bining the source entry 
, point, Stanford University, with the subject entry poftits of mathematics and ele- ^ 
mentary education. Furthermore, there may be several sourpe entries for Stanford 
- Umversity. ^ - ^ \* 

C^puler-based information retrieval systems can largdy overcome many of the 
limitatiDns of manual systerns if properly designed. In most 'cases computer-based 
••retrieval systems not only allow the user to combine several retrieval parameters, 
butnhey also provide relatively rapid^esults. There are two major categories of ^ 
computer retrieval systems, each of which' approaches the retrieval problem in a ^ 
" somewhat different manner: serial search systems an.d direct access systems. 

>Serial searclTsystems were^the first to appear and were widely used during the 
early 1960s. With^his sQpproach, the collection .or data b^se Jc) be searched is- 
normally contained, on magnetic tape in sefial fashion. .Hach record represents a 
document and contains the information elerjjents found on a library catalog card ' . 
(e.g.. title, author, source, .subject headings). To perform. ;i se;\fch, a us,cr fills out a . c 
form in which he describes as* nearly as possible hi^ irltercst. This search request is 
then coded by a person familjar with the collection and entered into the computer 
(usually along wi^th several other search requests). The computer is controlled by a 



E-.4 



150 



LOCKHEED PALO ALTb RESEARCH LABORATORY 

40CKHIf.O MIfflllf % SfACi* COMPANY. INC 
A $UI$l6lA*IY OP .lOCXHIlO AIIClApf COIPOlATION 



LMSC-D560986 



163 



DIALOG SYSTEM 



rclativcTj simple search Wogram that causes it to read each successive record from 
magnetic 'tape, to Compare the contents of the record with the elements specified in • 
the search request, and then to copy the record -out to a second magnetic tape it 
there has been a match, or to proceed to the next record, if the collection is large. ' 
It can take several hours- for the* computer to process the seai;ch. requests, f urther- 
more, if the request has been too specific, the requestor is likely to get few if any 
Results; if the specification has been too " broad. Jhe requestor can, get several 
hundred citations printed* out which he then must e-xamine: Bccajise the request 
had to-be .processed through an intermediary, there may have been further degra- 
dation in the quality of the results. • ' - 

In direct access .systems. Indexes much like Jback-of-the-book indexes arc con- 
structed from the collection. For each in^ term or descriptor, the .locations of all 
records in, the collection containing that descriptor 'arc lis^ted^on a direct acce^ de- 
vice. This ^dex is commonly known as an inverted file. Whereas the book index 
, indicates the locations of ^ages containing particular information, the inverted file 
indicates locatioris^^records containing pai^icular information. The main collection 
is also located on a direct accejy; device. This file is commonly,.called the linear file. 
It is thus possible for the computer to look aip a particular ind^x term ip the in- 
verted file, to re^d off the list of locations or addresses for the, citation recor^ds that 
contain the index, term, and then to accesi^ directly the linear file for each location 
to copy thd appropriate record — either to a display, as in the casp •i3f an on-line 
-45 system, or to a printer, If t^is K^^s been specifi9d. 

Whereas iferial^ search systems can be effickntly operated only in a 'batch itiode. 
(i.e., each inquiry specifies the complete search * process to be performed), direct 
access systems can be'design^d to be operated in either a hatch or interactive mode 
(i.e., wherein the user can control and* redirect the search process during execution). 
Typically, serial search systems are simpler and less costly to design but are more 
costly to operate than direct access systems. Direct acce?is systems which provjde 
Jor user interaction can typically produce higher quality results (i.e., a higher pro- 
portion of relevant results with fewer items missed). . ^ - • 

Interactive systems pan be further distinguished according to the rate and amount 
' of informatioi? 'transferred during the search process. Systtms designed for visual 
display terminals usually operate at relatively high spegJs (120-240 characters per 
second) and transfer; a larger ampUnt of information but cost more to operate than 
teletype terminals, which operate at relatively slow speeds (10-15 characters per 
' \jS0cond). ^ • . , 

It was decided from the outset that. DIALOG was to provide, waximum interact, 
tion between the user and the file. As "h result, and even though relatively uneconomic 
at the'timq (1966), DIALOG' was designed to include a terminal consisting of both a 
"high-speed cathode ray tube display and an associated. hard copy device (see Figure 
1). From the user's point of vjew DIALOG consists of several plain Engli^ coi?i- 
mands, such as DISPLAY, PRINT, and SELECT, which allev^ him to perform 
information rctrievarfunctions. Comtfisfhds'afe defined on the special characters 
above the;numeric keys on the input keyboard so that a convenient command label 




ERIC 



E-5 . 



151 



LOCKHEED PALO ALTO RESEARCH LABORATORY 

lOCKHffO Mis V Ills* 4 SfACI COMP'ANY. INC 
A SUISlOlA^r OF lOCKHIIO AIRCRAFT CORPORATION 



LMSC-D560986 



'OIAL06 SYSTEM 



164 





FIGURE. 2 DIALOG input, keyboard with a command label strip. 

strip can beVattached to the keyboard to identify the commands (see F4gure 2). 
The commands are so designed that no prespecified sequence must be followed*, 
i'.e., the user is free tojselect any command he considers appropriate for the next : 
step bf the search. Consequently, the user <;om'pletely controls the search procegs* 
At any point he can branch off the main path of' his search to explore associated 
ideas suggested during the course of the search' The command key 'orientation re- 
sults in a very sfmple clerical procedure: depress command key^ key in operand " 
data, press TRANS kdy to transfer the entire message to the computer. Corfecti<Mis 
are made by backspacing and typing over incorrect characters. Following entry of 
each command, the* system responds wjth information that assists the user in 
deciding the nex^step to Jake. , , 

The final implication of the comnjand orientati^op^iHthat the search proccfss is 
broken up into a sejguence of small steps, each of which is^^ery simple, and each 
of which results in feedback from the system. In this manner each step is completed 
.correctly before proceeding, thus eliminating the need to reenter the entire search * 
specification in. case of an error, as must be done in batchfype systems. 

In the context of these fundamental considerations, DIALOG design character- 
istics> will be discussed with regard to si^c fundamental steps which are more or less 
followed in any 'retrieval process: ' ' ^ 



\ 



(1) Identify and select index terms which characterize the search interest. 

(2) Coordinate individual terms into concept groups. 

(3) Sampl^e gnd evaluate intermediate search resuhs. 
(4> Modify (1) and/or (2) and redo (3). 

(5) Output results. - ^ 

(6) Review actual documents. 
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Machine implementation of each-stepV?^l be compared with thb historical solution 
in using the card catalog. ^ • ' , 

'Infusing a card catalog, the searcher selects a generic noun or noun phrase 
related to his search interest and scans through the alphabetically ifrranged catalog 
entries looTcing for a matci or a cross reference. Tf it is a large catalog, finding an 
acceptable entry can be time consuming. Most libraries do not provide a published 
catalog guide or index that would enable the searcher to identify subject headings of 
interest before approaching the card catalog. ^ ' .4 

In DIALOG, two commands, EXPAND and SELpCT, are provided to a^sftt 
the user in identifying and selecting desired index tejms. One form of EXPAND 
provides a display of the alphabetically near 'index terms- to the term entered. to- 
gether with an indication of the nunaber of citations indexed by displayed terms, and 
also the number of crosa, reference or related terms associated with each displ^ed 

V term. Figure 3 shows the display resulting from the command EXPAND "INTER- 
ACTION." • Each displayed term is numbered for easy reference. Artother form of 
the EXPAND command allows the user to display thd related terms in the s^ 
* -format as that just described (see Figure 4). The user is thus provided a window to 
the index and thesaurus to assist him in identifying useful index terms with which to 
characterize his search' interest. 

The SELECT command enables the user to construct a list of desired index terms 
for future reference. SELECT entries result in the definition of file subsets (referred 
to simply as. sets) which are tagged with *'set numbers" and are printed out on the 

^ terminal hard copy device. ' / 

. The command, SELECT **eOMPUTERS " for example, would result in the 
following output at the terminal: ' ^ ^ 

. ^ • ' Set No. in Description of .set , ^. 

Ntf. set. , (4- i=:or«*-fnnd. — =:not) 

1 558 COmFuTERS . ' ' 

Once selected, a term (or more exactly, the file subset associated with the term) 
may be referenced by its 'set number. Citations associated with any set can be dis- 
played, printed, selectively saved, or combined with other sets. If a selected term 
cai^ot be found, an error message is printed out for the user who then can auto- 
matically display the alphabetically near terms by depressing the EXPAND key. 
Each term is thus vajidated at time of I'ntry, ahd the frequency of^t^rm use is re- - 
corded for later reference. ^.^..» ** \ - . ■ 

The card^gatalpg confll^jKtatic collection of precoordinated subject headings 
(at least in thTshort ru^^^cone other than the searcher had to decide a priori the 
appropriate categories to be provided for retrieval If categories are too broad, the ° 
searcher mus^ manually examine a large -number^ ol"citaiu>ns to satisfy a specific 
• ^ ' 

tKcycd entries by uscf are shown ih quotation marks to (Iislio|insb thenn from commaml 'i^w-s 
entries. • . > 
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r * • 

\ EXPAND IT=INTERACTION ^ 

RFF DESCRIPTOR ' TP CIT RT 

* * EOl IT:=INTER INSTITUTIONAL 

PROGRAM DEVELOPMENT - - 1 
E02 IT=INTER ITEM CORRELATION^ * 

COEFFICIENTS -^^ 1 

E03 IT= INTER NATION , ' 

SIMULATION ' ' 2 

E04 IT= INTER-AMERICAN TESTS 

OF GENERAL ABILITY K 
EOS I-Eir INTER-UNIVERSITY 

project one 3 

e06. -it =: interaction 282 9 
e07 it= interaction analysis . 2 1 
eos it= interaction analysis 

scaIe ' ' 1 

f09 it = interaction op" . 

matter and energy. " 1 

elo it=1nteracti0n process 1 ' 
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FIGURE 3. Display of alphabeiicalh nea4 ttrms to "INTERACTION: 



subject interestr If categories -^j^ narrow, the number of catalog entries becomes 
unwieFdly to use! In the traditX^al catalog, there is no way of combining categories 
at search time to, provide broader or more specific categories. 

In designing DIALOG,* it was desired not only to provide the user means of 
reviewingxthe citations within a particular category, but also to allow him to define 
dynamically his own categories ^by^logically combining the results of several in- 
dividual categories. This function was provided in the COMBINE command. With 
COMBINE the searcher can cpmbinc any number of citation sets in any logical 
manner. Cor\trnuing the above^examplc, assume the user is interested in the interac- 
tive use of computers m information retrieval. He might go through tlTc following 
steps: • - ' \ , 

• - • Terminal output 



Command entered 



No. 
1 

2 
3 
4 
5 
6 



SELECT "C0M{>UTFRS" 
SELECT "INFORMATION RETRIEVAL 

COMBINE "rr; 

SELECT 'iNTEkACTlON** 
SELECT "MAN MACHINE SYSThMS'; 
COMBINE "3*f44-5r 

In tfte above illustration, the user combined concepts of '^COMPUTERS" and 
'iNFORMATION RETRIEVAL'* into a single category containing 72 items. He 



No. in 


Description of set 




set 


( =or.^=and, — =n6t) 




558 


5 

COMPUTERS^ 




. 441 ' 


. INFORMATION RETRIEVAL 






1*2 • , • 'i 




282 


INTERACTION 




^93 


MAN-MACHINE SYSTEMS 




17 


1'^2*(4>5) 
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282 


9 


2 


1 


80 


30 


14 


3 


332 


12 


172 


8. 


22 


5 




2h 


93 


12- 


768 


24 



1*7 * /DIALOG- SYSTEM 

EXPAND IT= INTERACTION 
REF- DESCRIPTOR • TP 

* ROl -IT=INtERACTIO^ 
R02 IT= INSTRUCTIONAL 

. ' INTERACTION / 1 

R03 IT=RELATIONSHIP ^ 3 

• R04 IT=AUDIENCE ' 

PARTICIPATION ^ ' 4 
R05 IT=INTERACTION PROCESS 

ANALYSIS " 4 

R06 IT=INTBRGROUP RELATIONS 4 
R07 IT==INTERMODE \ 

DIFFERENCES • 4 

. R08 ITrrlNTERPERSONAL 

COMPETENCE V ^ 4 

R09 • It=MAN MACHINE' SV^tEMS 4 
RIO"' ,IT= STATISTICAL ANAji^SlS 4 

^ FIGURE 4. Display of reUted tehiis of 'INTBR ACTION r 

V r ' 

decided thai he could be^more specific, and sp he combined this result with a new 
concept made up oi categories '*INTERAC>y1fON" or "MAN JylACHINE SYS- 
TEMS'* Avjjich were obtained from the dispFay.shown as Figure 4^^'$his example can 
be developed as the cumulation of a.series of very simple. steps, ' 

Scanning the titles of entries under a particular subject category in the traditional 
card catalog allows tfie 'user t© select specific crtations or int.^4u<st. Frequently, how- 
ever, other subject entry points for a particular item are not included on the catalog 
card, which denies the user the information he needs to explore other related areas 
of interest which might be suggested by the citation. 

The DISPLAY command in DIALOG was designed to allow the user to review 
intermediate r^esults. Of several formats available.- that most frequently us'ed pro- 
vides a drsplay of the entire citation including all assigned .descriptors ancj a descrip- 
t * • tive abstract if. available (see Figure Supplying the f^ll citation not only enables 
(Jhe user to evaluate the relevancy of his sci^cch to that point, but it also shows Kim 
alternative descriptors he can explore or can include (using the COMBINE com- 
, mand) with'other prcviousl}^ developed categ^ics. Figure 6 '^hows the associated 
abs^act that may also be displayed. ' ^ ' ' 

♦ c^^^ catalog user finds relevant .citatio^iSj^^Fie^^copies down their calf 

' ' -tfumbers for use in obtaining the associated d[pcumfc?^l§. If tes^^Jshcs to devplopi a 
bibliography for future use or publicatiofu he" is relegated to coj^ng manually t^e 
entire citation of*each. selected entry. . t 
Two output commands are provided the DIALOG. user which are identical except 
^ for the target device.. PRINT outputs indicated sets of citations to -the high-speed 
printer at the computer: TYPE similarly outputs to ^he low-speed ^:Vminal printer. 
Normally the user will output accession numbSfs to- the local printer for iise in 
- obtaining hard copy, and he Will usejhe high-speed printer at the computer for the 
output of extensive bibliographies. 
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AN INTERACTIVE 1NF0RMATI0N-41ETRIEVAL SYSTEM; 
CASE STUDIES ON THE USE OF DIALOG TO SEARCH . 
THE ERIC DOCUMENT FILE. 

TIMBIE, MICHELE; COOMBS, DON H. 
STAtSFORD- UNIV., CALIF. ERIC CLEARINGHOUSE 
ON EDUCATIONAL MEDIA. AND TECHNOl^OGY 
RMQ66000 * ' ° 
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VAL/ -INFORMATION SYSTEMS/^INFORMATION THEOR 
Y/ INPUT -OUTPUT DEVICES/IN.QUIRY TRAINING/ IN, 

TERACTION /RESEARCH/ ♦SEARCH STRATEGISTS/ 
• 

FIGURE 5 Display of full citation 
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At prcsenrmosl library coMcctions arc not available in machine-readable forfn. 
Provision has been made in DIALOG for each citation to be associated with a 
second record. This record can be an abstract or it can .be the entire text of a 

document. _ , ? ' ^ 

^'Of more practical iriterest^at the^l^tfesent is fnterface to "automatic -microfilm 
equipment. DIALOG has bedn used with several of these devices, any of which can 
contain lull document text. . . ^ 

In practice, DIALOG provides the user an easy-to-use command language that 
extends rather than replaces tbe concept of the traditional casd catalog. DIALOG 
extends this concept By providing a means of combining subject ^categories and by 
providing the clerical facility for storing, cumulatmg, and printing desired citations 
in a variety of formah. 

\ The initial application of DIALOG occurred early iri 1967 when a DIALOG 

' terminal was installed at the NASA Ames Research Center. Moffelt Field, Cali- ^ 
fornia. The system" was used to conduct on-line searehe^ of the NASA document 

_ citation collection which at that time numbered some" 300.000 records. This data 
base was stored' in a mass storage device at the Lockheed Palo Alto Research 
Laboratory, and communication was conducted over a telephone line. During this 
first application. DIALOG was used principally by engineers and scientists directly. 
During the second phase of the NASA application the terminal was relocated to 
NASA Headquarters in Washington, D.C. for' 12 months. By this time the file,*ad . 

' grown to 450,000 citations, the largest bibliographic collection of document Citd-., 

. tions searchable in an on-line, interactive mode. DIALOG was used principally by ^' 
librarians dicing this second phase. U^age differences between the first aifd second* 
phases were analyzed in a ftnal report submitted' to NASA (/). 

jdj Lockheed has recently completed a contract with NASA to develop and install ^ 
version of DIALOG known as NASA/RECON (Remote Console). NASA/RECON 

. is currently in daily operation on a NASA computer servicing twenty-three^ terminals 
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h 1)0^443 1 

I HI- MRS I INri-KArilVI (ON-I INJ) (OMPUn-RI/Kn ^ 
- ..^liSt* Oh JHI \,\\\S BY \HV US OhMCi Oh hO- 

IK XIION ji:^ KMH)RM O IN I HI hORM Of- AN hVAI - 
UAIION or I HI. DIA!.(5C. SVSM M ( ONDIH* IhO AT 
IHI 'hRK C LhXRlNCiHOUS!' l OR ! j>UCAT!ONAI. 
MhDIA' AND.TFCHNOLOGY. Df-SCRIPHONS O! .T^Hh' 
PURPOSES Oh WW ^^rUOY OH I HI* iblALOG SYSJ hM 
(DKVELOPRD BY LOCkHM-D MISSILES AN!) SPACE 
CO.). AND Oh THE PROCEDURES ) NVOKVEO IN CON- 
DUCTING A SEARCH OE THE ERIC hlLE USING DIA- 
LOG ARE EOELOWED BY INhORMATlON ON THE NINE 
PEOPLE. EROM VArToUS AREAS OE EDUCATION. WHO . 
t WERE ASKED TO HELP EVALUATE THE SYSTEM THE 

MAJOR PORTJON Oh THh REPORT. CONSISTING OE 
NINE CASE STUDIES, IS BASED ON THE REACIIONS 
OE THESE EVALUATORS (GATHERED IN DEBRIEEING 

, INTERVIEWS) JO ONE OR MORh DIALOC^ SEARCHES 
WHICH they' THEMSELVES CONDUCTED. IN ADDI- 
TION, EVALUATIONS (BASED ON QUESTIONNAIRES 
hROM bT>IER SYSTLM USERS) ARE PRESENTED. 
/rHhSE. AIONGWIIH mE NINL ORIGINAL FVALUA- 
'^nONS. .STRESS THE'SPhLO AND "HORl/ON-WlDEN. 
- . ^"lNG" EEEECT OE THE SYSTEM. A EINAL SECTION EX- 
AMINES THE VARIET Y OF liShS FOR THE SYSlI^^ AT 
THE CI jilAUINGHOUSE THE PRh DIALOG QUESTIONS. 

' THE DEBRIEEING OUTLINE, AND RECORDS Oh THE. 
EVALUATORS- SHARCHES^ARE APPENI^ED 
'(SP/MT) • • ^ 

^ ' FIGURE d.^llxamplc of di^pUixablc abstract, * 

located in ^ASA facilities across the c<)untry,< Lockheed installed and maintains 
another version of this systCnj^ in Europe -for the, European Spacc^ Research Or- 
ganization (ESRO). ESRO support?^ terminals in several European countries from 
a'central computer facility in Germany (2). 

During the past 2 years Lockhcjifa has supplied remote terminal retrieval ser<'iccs 
to three Office of Education fi^litics with the Education Rtscarcli Information 
Center (ERIC) files (i). and four Atomic Energy Commission facilities with Nuclear 
, Science Abstracts. ] ^ ^ , " ' 

' , reeerenceA . . 

L Roger K. Summit. Rcm^c Information nctncval FacilUy, N'07-68-1. NASA CR-1318. 
Lockheed Palo Alto Research Lat^yratory, 'Palo Alio. California. ' ; 

2. N- E. C. Isotta. "F.uropcs Eirsf^ Information Retrieval Nctw(>rk." -ESROfEWX) Bull. 
(January 1970), - ' i ' 

3. Roger K Summit. ERIC, Onhnr Rd^tncval Sy^tem^Usc of the DIALOG Onlmc Information 
Retrieval Svvtem With ERIC Research in Education '/'/7f5/ N.6R.7(j-L ^(Kkhcetl Palo AUo 



Research Laboratory. Palo Alto, California. April 1970 
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Appendix F • * ' ^ 

THE PROBLEM OF RESOURCE SHARING ' ; ' 

While the concept of a central search* facility is appealing from tiie point of view of ^ 
obtaining sc "critical mass" of searches and using skilled searchers, it is impprtant 
tp indicate t'he important problem of resource sharing. We therefore present below * 
thearemarks of David C. Weber, Director of the Stanford University Libraries, and 
a membeir of the Cooperative Information Network (GIN) Board of ' Directors, as given 
in News Notes^of GalLfornia X^ibyaries , Vol. tO^ No. 1-4, 1975.- 

V 

In some ways the .GIN Board of Directo;rs bias found tlje most ^ 
irustratiftg'aspect to.be the lethargy of professional staff atiJiie 
cirqulation or reference desks our libraries,^ whether/ the^ be • 
large or small. The public do not always seeiii to be tl^e group 
.i? which needs to be convinced of resourceyShatring; the ^librarian 

and senior' clerical or technical staff who conduct our fropt desk 
operations seem the^weak link. Some of them are of course - \ 
superb. ' Nevei^eless it h^s been appalling how much evidence 

# • accumulates. that ^when a request made f6r information, "the 
Ik . answer is often "this is all we hav^* or "you would have to try 

some otheV Ijlbrary" or "we do not have the current information 
but these three items from our collections may provid€f yoi^ with 
some help." True that |:he staff is often very hard pressed. 
• " ' AU of us feel short of staff, and We are spread over very l^ng 

Hours. Howler,* if 4^e are to usei shared resoui^ces th6 seirvice 
J staff must take that^extra step to tell the patron "|but in 24 hours 

I can have it from a special library in this area, "may I obtain 

* it in photocopy from the Leo Library ii^Louisiana" or "if you can 

give us a week, we c^ borrow that particular edition froni^ne , * 

^ of these three libraries and it will be here next Thursdty between 



4 and 5S)*clock." 
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Resource sharing requires an aggressive attitude, and'it 
involves a laferaj thinking process. A good deal -of effort 
by the CIN staff has gone in^q spreading the message to ser- 
vice librarians of what resources there are right around the 
corner, how thg CIN network fian be made to help them meet ' 
'the needs pf their patron's." Circulation and reference librar- 
ians may be very good in a traditional' prpc ess but on the 
whole they do not do well when nieasured^against the demands 
of operating in a fully effective sharing network. Here seems 
to be an area where library schools need to teach a different 
operational attitude than may have been previously adequate. 
Continuing education prograiiis for staff development of those 
who interface with these cooperatives seem an urgent need. 
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. • . Appendix G 

COMMENTS OF OVERSIGHT COMMITTEE MEMBERS 



We Invited members of the Oversight Committee to comment on the DIALIB project > 
and/ or other topics that they felt were pertinent to online retrieval in the public 
library. We felt that as critics and reviewers of the study for the past 3 years, they 
were in a unique position to provide additional insight and evaluations. 

G.l VIRGINIA ROSS GELL]^, GELLSr AND ROSS; LIBRARY CONSULTANTS, 
REDWOOD CITY, CALJFORNIA . ' * * 



This is an interesting and significant project Aj^iph has provided an opportunity for 
public libraries to experment With computer-assisted reference service. -As is the 
case with many demoq^ation projects, the service was regarded as something, 
separate and distinct from^the regular activities of the library. In this xjase, the^ 
* tendency for such thinking was increased because use of the service required a new"^ 
^technique for accessing -information^ Because of this attitude toward the projec}:, the 
potentials, requlrementa, contingent problemsL of online^ data baae Searching ap- 
pear nqUo have been.considered in the framework of ti^ library's overall goals and 
objectives. I believe' it is significant that only two of the librarffkn participant^ make 
' any mention of relationship to ^oals and objectives in their comments relative fo 
DIALIB. Reference personnel usually seem to have regarded it a« someking aside' ' 
from their norrnal reference service and most of the participants seem to r.egard, on- * 
^ line data base searches as a new function rather than as another means of performing, 
a reference search. , . . * ' 'J , - 

' I believ^e the study could have provided more useful informationjf^tiiere had been 
provision during the l&st 2 years for-library supported searches^so that the reference 

^ librarians- could have more fully e;cplored* tlie reference potential of computer-assisted 

i ' J ^ 
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reference searches' in their particular settings. Once the patron fee was established, 
# the libraries lost the ability to make discretionary use of 'D^ALOG^when they consid- 
ered this the b^st means of answering a question/ C6nversety,. they might have to 
make a nonproductive search if the patron was insistent in his desire for such a search • 
Provision for discretignary use would have added a useful dimension to the project. 
^ Althou^ there was provision for free ''demonstratiojv'J-tjme, this was intended for use 
in.learning new data bases and for providing demonstrations and wa§ not available for * 
conducting patron searches.. . • c ^ ^ ' 

As an observer of the project I have been disappointed and coAcerned that the public 

library Admii4strators ^d not appear to have a clea3?ly thought-out rationale for the 

imposition of user fees for DIALOG searches. Without such a rationale I believe there 

is a definite possibility that a local government^, in^its search for ways to reduce taxes, 

may pursue the user fee concept in a majuier ultunat'ely harmful to the general public^s 

, access to more traditional. aspects of public library services and resources. Moreover, 

failure to recognize the.increased level of service made possible by coniputer-assisteA 

^ reference service, and to evaluate cost in^ relation to benefits, could very well resu\jt 

in curtailment of the public library^s ability to move ahead with new developments in 

^ " ^* * - -* * 

resource availability. The easy Acceptance of the user fee^for these services makes 

it appear as thou^ the library administrators had already made a predetermination ^ 

that the technique ofK>nline dkta.base searching and the resources, thus-available were * 

! o really not appropriate to the public library. In my opinion, this, is a.narrow and very ^ 

short-sighted view. ^ ^ . 

/s^^ I am also disappointed that the project^did n6t fully take advantage of th'e -opportunity 

to explore the use of online data base search in artwork fraxr^ework. In view ofcin- \ 
creasing epphasis on library networking and continued limited 'availability of public 
Ubrary funds, it appears likely that publip library access to data bases such as , 

' s DIALOG will be furnished bfy a fe^y libraries on behalf of network membe:^s; thus the 

patron aoc^ess will be.indirect ojrjdeferre^. Te&Linal installations in the project were 
well suited for exploration of this/aspect: San'Jos^^, Capertino, and Redwood City had 

0-2°; ■ ■ •■ I . . 
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heavy "walk-in'' traffic; the San Mateo Couftty installation had little "walk-in" traffic 
but served as headquarters fo't p. network of Branch libraries and also was ^'ccessiblei 
to the seven member libraries ot the cooperative Peninsula Library System. Although 
<he study t'akes note-of some of, the problems'inherent 1^ "indirect" access, ^believe 
much more attention should have been devoted to this a'&pect. The data" seem to indi^ 
cate that t|ie service was not used in a truly network manner, i. e. , as a service to * 
iaidependent members of a*cooperative system. For example, of the total "indirect" 
requests reported for San Mateo County, only six olM.65 came from Syltem member 



libraries. Although Redwood City Public Library patrons we»e eligible to use San 
JMateo County Library for data base searches, no such use is reported. Redwood City 
had a very high usage during their participation in the project; it would seem logical 
to hgv-e-redirected this patronage when the Redwood G^y terminal was removed a*^year 
prior *o the end of the project, parUqularly so since the Redwood City staff was familiar 
with the data bases and the search strategy. An investigation of ^vhy this was not done 
would Jiave l^een instructive. • . ^ ' 




The difficulties of gbtaining effective utilizatibn by staff in outlets remote from the 
terminal is noted, but it would be useful if tlje study had devoted more attention, to , 
efforts. and techniques to encourage such staff to^make effective utilization and viable 
referrals to the terminal access point. ^ ' ^ 

*> . ' >' " • » 

The need for training and continuing education to maintain professional pompetence 

in the changing technolojgy and state of the art of the library field is clearly demon- i 

styated by thig project. Librarians should ^n^ulate other .professions 'SUch as law, 

medicine, and public; administration, and work to secure such update training^as an 

accepted part of their professional status. ' , " 

• • • * 

In' summary: it is unfortunate that the "fee fiQr service" aspect has confused the issue 
by diverting attention from the ijiore basic aspect, which is the value o^fcomputer- 
assisted refe^-ence services for public libraries. Thy^asic questiOh is whether this 
i3 a tool which public libraries should^afdd to their other bibliogr^hic tools for*acce§s- 
ing resources. J believe this study gives a positive answer to that question and 
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provides* constructive guide lines to other libraries^^eeking to use this means to 
enlarge their service and resources'. 

G.2 DOUGLAS FERGUSON, HEAD, DATA SERVICES, STANFORD UNIVERSITY 
^LIBRARIES ^ . / 

The DIALIB Project ^as a field study tod not in any sense a designed social experi- 
ment. Several choices were made to#mov6 the project J^oirw^i^d within the contexf of . 
working libraries. Many alternatives were not explored, but alternative, ways of 
making online reference service work were revealed. For me this is the maiu value 
of this project. It illuminated problems in introducing, an innovative service into pub- 
lically, funded organizationi^. It revealed various policj^ decisions and operational 
.choices. It showed the critical importance of individual m^otivations and attitudes in 
the change process. - ' 

The project suggests alternatives in funding, in operation, and in marketing computer- 
supported reference service. These alternatives apply not just .to public libraries biit 
to libraries in'^public and^^rivate educational institution^ and possibly to other types of 
information service organizations. The following observations should be considered 
to have the usual wisdom of 20/20 hindsight and the humility of the bystander discussing 
.the ligh'tness of other peoples* burdens. 

. ..) •■■ - . ■ . ^ ••■ ■ ■ ■•• 

Funding Alternatives . . / • 

The record does not show that the project participantsSactiveljf considered ^ding 
alternatives such as price-free service or full^ us^-supported funding. Pmce-fi'ee 
service would have been in the public library, tradition. Perhap^ iDiecause of the 
original project proposal and structuring, price-free service was nof considered a 
viable alternative. It is my^personal and professional belief that computer- supported 
reference service can be offered on a price-free basis in public and academic libraries 
and that this is not only a viable but a desiralble altepiative WHEN THE LIBRARY SEES 
IT AS SUCH. ' ^ . ; - • " 

- i*-- 
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The same constraints and choices apply to traditional reference service as apply, to 
computer-supported reference service. When the similarities rather than the diffei^- 
ences arfe emphasized, a price-free service- structure can be made to work. The ' 
^fals'e dilemma that plagued the thinking of many of us,' and I emphasize that this in- 
cluded myself, was not free versus fee service but total versus balanced access *fo 
■ service. No library offers unlimited access to its resources or facilities. Every 
library choses what spurces. how much staff time and talent and what access condi- 
tions it will offejc to the public - and so does virtually every other pu;)lic service * 
. organization. If we select wiich.print^ indekes%e cap afford, Why'can't we%elect 
which data bases we can affor^? If we select staff .and books.on the basis of the sub- 
ject emphasis that meets the central needs of oup clientele, • why can't we select data 
bases and train staff on the basis of our primary subject commitments? If queues 
form at referenc.e desk^ and on phone lines and people are served on a deferred basis 
. ("all.pperators are busy, ^our call will be taken in the order received. . . -) why can't ' 
online searches be handled on aiirst-come and then deferred basis? we chose not 
to attempt to answer certain t.j^pes of questions (e.g. legal, medical, puzzles). why 
can't wi^ide those types of questions f6r which we cannot do online searches? 

The list of analogous- questions can go on to each aspect of how information service is 
offered. BuUsn't this'a negative approach, always stressingjjjalts.'or what we will 
- NOT do? Perhaps, but it seems to me that what resultWj&these choices is u type" 
of service that balances. available resources across a spectrum of library services. 
By carefully monitoring the results of these 'choices, such as service backlogs or un- 
answered requests, we have the basis for reallocation^ people and money resources 
. and for^pporting budget requests. ' • 



The professional literature is recording a dispussion in which the problems of lees 
and the rationale for Rrice-free servicers well represented and I will not add to it. 
I emphasize, at a minimum, the common-sense practicality of price-free service but 
not its iron necessity. 'Furtliermore it seems to me there are pra^atic benefits of 
price-free service, in terms of extending access, removing unproductive accounting 
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activities, and building a broad base of professional experience and clientele support. 
The project report suggests decision area^ that coulS lead to structuring a price-free 
service around selected data bases, using selected staff, under conditions that permit 
the operation of a balance^ reference service. Xil^arians and library managers do 
have scope for choice in funding computer-supported reference service. Price-free 
service has not been tried and found w^^nting; as -Shaw said about Christianity, it has . 
been found difficult. ahd -not tried. , p % " 

Improved Operations . * • ^' ' 

The project did not explore but it did suggest the way in which online sources could 
be used to assist with the major types of inforn^ation requei^ts faced by a public (or 
academic) library reference service*. Data bases can be appropriately us6d to answer 
fact or brief response questions (e.g., estimates of the volume of pocket calculator" 
sales in^l980), to answer short topical questions (e^g*, a few recent articles on appro- 
priate technology), as well as to answer questions requiring^xtended subject searches. 
It may have been a missed opportunity when the libraries did not plan to try limited 
use of data base searches with daily on-demand reference reque,sts. Even though data 
base sources were not systematically used with differing information tasks, they are 
clearly applicable especially as the data base repertoire expands. Furthermore, as^ 
online sources become more common in daily rieference activities* it wiirbecome im- 
portant to develop and test guidelines for the appropriate use of printed and com- 
puterized sources in responding to informattoij^equests. The guidelines would help 
to determine when computerized sources alone might most effectively produce a result, 
when printed sources alone infght produce the desired result, and wh^ both^.computer- 
ized^d print source^ are likely to provide an appropriate response. The advent of an" 
online reference ejection may hasten the ^refinement of guides* to query negotiation 
and source. selectnBBhat are beginning to appear. . ^ \. ' 



I airi speculating that online sources will be an accepted,and common part' of inost 
library reference activity -within the next 10 years. If this h^pens, librarians can 
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become a significant force in improving data bases and Recess methods by applying 
-' critiqal standards \o these information sources just as they would to other kinds'of 
. information sources. ■Equally as important will be the necessity to develop practical 
' ways of determinirig^he quality or goodness of the results we produce ffom data bases. 

Systematic sampUng for analysis, peer group searcli autopies, and settings to which 

problem seafcheS can be brought, are examples/of the kinds of professional and 
"organizational incentives that are needed to produce a peer-based approach to service 

quality and, professional accountability. 

Markets and Marketing '. • . ' • , 

The project is rather limited in the extent to which it reveals the market structure 
for online reference service . ^he markj^ structure for various goods and services 
. of public libraries has not been Explored in any depth. It may be asking too much for ' 

computer-supported reference service^to pioneer in market analysis. A study of ' . 
nonusers of computerized literature searches would contribute to answering several 
questions: (1) Are fees a deterrent to use, tq^whom are th6y a.deterrent, and what 
conditions would bring about active use? (2) the nonuse based on lack of-nefed, lack 
of awareness of the service or problems in gaining access to the service? and (3) Are 

. nonusers jDredominantly part of groups to which the.library\nd the commuhity gives a 
service priority, such as ethnic, or disadvantaged groups? Nonuser infornlation 

/alorig with information on service users Vould help structure pricing, service design, ' 
and promotion decisions. , ' . ^ , • 

• Most marketing promotional approaches were triea in the project at least once and ' 
they ranged from direct mail to public relations' approaches to the medico direct 
sales approaches in the form of live demonstrations. The problem of sen^cte over-' 
load, whether feared or actual, dominated the situation, ■ so promotional- appfoaches 
that go beyond the present library market were not tried. The problematic character ' 
of promotional activities extends beyond libraries to most tax supported service 
organizations. If an organisation succei^uUy promotes its services, if increases ' • 
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demand. Increased demand, in organizations without pricing i^echanisms, does not 
result in more resources t^^keep up with demand. Hence service degrades and more 
people are brought in byj)romotion only to be disappointed by what they get or "don ^t 
get. Furthermore, there is no tradition of promotional budgeting in most city agencies 
and public employees may ri-ghtly be responding to a belief in the public and in elected 
officials that public agencies 'should spend money on their substantive services not on 
advertising. Public promotignal money must be initially tied to a^high priority ser- 
vice, must be focused on specific target groups, and must be low in cost. Building 
^ a promotional budgeting base and in-house promotional resources take? yfears and they 
,jnust alwaysSe rejustifi^ and kept lean. This is not all bad since most advertising 
researches say they don't .know what wOrks and fioesn't work with ^ny degree of assur- 
ance. Meanwhile a great deal of money^ can be spent. To paraphrase Baron 
Rothchilds, there are three ways to spend a great deal of money, gambling, /ine wine, 
and advertising. The first two .are the pleasantest, but, the last is by far the most 
certain. . ' 



li marketing is basically four clusters of decisions — pricing decisions, p^^omotion 
decision-s, delivery decisions and design decisions — the last is the mosj problematic 
for tax supported 6rganizations. Designing goods, i&ervices, or products to* meet 
clientele requirements is easjr^to say but it implies a great deal more flexibility and . 
Resources t;han most public agencies have. T^he public image of what public agencies 

^should provide controls the content and format of public ser-vices, and libraries are 
no exceptfon. In part this accounts for why the particip^mts in this project, along with 
almost all libraries, present the service basically in terms of a computer-produced 
biblio^aphy. Again, as data bases become more like Ford^s ^d less like Maser^>s, 

, imaginative service designs will be produced. They will be sets of analytic techniques, 
interpersonal' skills, and computer processing available for unique and recurring in- 
fbrmation tasks of the library's various client groups. The DiALIB Project has qon- 
tributed to conceptualizing and creating the conditions for this kind of publiclibraryf 
inf cremation service. . - 
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G,3 FORREST F. CARHAR^, JR., EXECUTIVE DIRECTOR, NEW YORK METRO- 
POLITAN REFERENCE AND- RESEARCH LIBRARY AGENCY (METRO) 



This was an important project, and was successful in providing most of the- sought for 

answers to the following questions: ' *' 

^/ ' • . 

• ' Is computer searching of value to public library patrons? . • • 

• *What is the impact of computer searching on the library and the library 
patron ? 

• What conditions are required for successful use Of computer searching? 

• Are there special financial or marketing considerations? 

The astut^ librarian reading- this report will, consider the experiences here neither 
the norm for libraries nor atypical. The size of library,' population served, member- ' 
ship in ponsortia; etc., necpssarily impose qualifiers on policies, practices, reac- ' 
tions of patrons and staff, ^dany concltisions which qjay be extxapolated. It is'obvious, 
I think<-; that mnbh of wbat wa,s learned could be tf-ansf erred with discretion to other 
libraries^. It.wouTd be fair to jsay tliat changes' which may come about from' the utiliza- 
tion of 6bmputer searching will be evolutionary rather than revolutionary. A receptive 
staff will benefit from this kugmentatipn of -their skills. 



J3 



The public library's role as a^inking agent would see^i now to be self-evident. When 
our questions were posed 4 years before the end of the project term, .the answers were 
not clear. In fact, this program provided p^rt of the proof that public libraries are a * 
logical place. in which to locate terminals for literature searching.^ Terminals are now 
■Commonplace in libraries which h^ve a demonstrated' need for them. 

There is no fundamental 3ifferende between doing a manual ^.search and a computer 
search. The principles of_searching are the sam6. The '/difference'/ most -often cited 
■ is not related to tfie technology but relates to the services customarily provided by a • 
' library. The role of the individual library^ information transfer (reference work) is 
affected by such factors as whether it is a small suburban or'iarge urban library; 
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whether the area served is located near research and high technology communities; 
whether the library serves mainly the recreational i*eading needs of a retirement com- 
munity;.the extent to which the public library participates in cooperative programs with 
nearby libraries and utilizes such referral and support opportunities; etc, 

The^ above factors (and others) lead to a question of degree — to what extent is the 
library accustomed to performing in-depth literature searches for its patrons? The 
library which is \inaccustomed to in-depth searching may find computer-assisted 
searchih^an overwhelming procedure in the beginning. Howfever, it is my opinion^ ' ' 
that most librarians have fallen into bad habits when doing reference work. The 
computer-assisted search forces the librarian to do a thorough reference interview 
before the search begins, rather than raising cjuestions as the search proceeds. In 
fact, computer-assisted searching is good training and discipline for manual search- ^ 
ing because of th^ reqdired precision of the reference interviews. 

Most indexes printed on paper and their counterpart computer indexes are used in the 
same* way. In facf, many originated as printed indexes, and use the same list of subject 
^headings (thesauri). As is the^case with printed indexes, each field of knowledge has 
its own subject headings and literature searchers are accustomed to using different sets 
of terms in printed indexes. The same can be said of computerized indexes. . 

The study showed that cooperative use of a terminal is possible and provides n^bar 
to good service* At the same time,, ijt was shown that not eyery library needs a com- 
puter terminal for literature searching just as not every library needs a hardpaper 

-cbpy of Chemical Abstracts. Libraries have always beenjnterdependent in these 
.iXiatters (hard paper) and they can be mterdependent in terminal ysage. A parallel ex- 
p^riment in New York has shown ftiat no library having a terminal will be overrun by 
patrons of another library. A library making heavy Hisej^f another ^s terminal will 

* soon find such a situation so inconvenient that it will obtiain its own facility. The 
shared use of a terminal provides an Opportunity ipio a* library to gain experience and 
data to support budget requests for a separate terminal. 
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In this, study, it was not possible to compare costs between manual and computer 
searches; This could only have been done if the libraries had previously routinely 
conducted in-^epth manual seeching. Since this was not the case, the advent of the 
terijiinal provided an entirely new dimension to the service of these libraries. This 
fabt is so basic that it pervaded all activity in the, study period^nd colored many of 
* the comments'coUected^y the evaluation team, - 

The j^ern of this study provided a progression from "free" searches^to "fully" paid 
searches. In retrospect, this would not have been necessary for public accfeptancye and 
if the 3 years had been entirel^y a "fully" paid period, 'we might havfe been able to eval- 
uate othfer varfables. It is my^eling that the gradual buildup to "full" charge was for 
the library staffs • fears which proved to be unfounded. It is Ukely thaFit would have 
been less trying to the libraf|' staffs If the reduced charge periods had never been in- 
jstituted. I, certainly would not recommend such a practice again. 

We learned some things about the impact.of computer-assisted searche/in relation to 
.the patron blit m'issed a goi^bn opportunity to learn more. As predictedj. a computer 
search saves ^wch time. i'Tlje most dramatic demonstration of this was the heavy use 
by st^ents.^^They coqid see'^the efficiency of using the terminal and its attendant costs 
versu^the money they could ^yn in tBe time a^anual search would have consumed. 

It was significant that^S;/ patrons returned for additional searches. That more did 
not is not significant. Except in industrial laboratory investigations (special libraries) 
and similar situations, it is most unusual to have a general patron retjurn for addi- 
tional in-depth searcJiUlg. ^ 



Unfortunately, the /evaluators did not investigate the reasons for repotted dissatisfac- 
tions.. For exampW we do not know whethet the patrons were-unhappy because no ' - 
citations were found and whether anj[ citations should have been expected. We do not ' 
know whether the questions were sharply defined or too narrowly stated. We do not ' ' 
know whether appropriate data bases were se.arched. In general, we can say that 
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dissatisfactioi^s reported by the evaluators are also reported from manual searchers 
in hard-paper indexes. More often unhappiness is in frustration or disappointment 
based on unfounded hope. In some cases, ]^axticularly those relating to doctoral candi- 
dates, the replied received may have been a response to a poorly worded question. 
Such a student niay very well turn up no. citations in his searching but at the same time 
this can be a happy result — he has found a topic upon which he can build his doctoral 
research. ' . ' . 

The impactg which may be expected in libraries will viry according to the nafure of 

the librSry arid the community it serves. If we think computer-assisted searches 

as a natural augmentation of our already hi^y developed sense of service and fine- 

tuned capabilities, most of the "impacts" are entirely predictable such as: the possible 

• * 

necessity to rearrange staff schedules to allow pre-search interviews with the patron; 
schediling of time for more intensive training for the utilization of new reference 
tools; necessitj^for training all staff for an attitude of support, not simply a grudging, 
acceptance; as well as similar aaministrative' problems most of whidi we shoald Have 
^facdd long ago in our.manual search days. * . 

One item whicl^j^s been labeled a problem has in recent months been raised into a 
nSghly! emotional cause celebre'— =an unfortunate occurrence. This has to do with whether 
a library should or may charge the patron a direct fee for this or any service.' I think 
the stujiy responds to this question although the evaluators failed to probe sufficiently 
yxo write convincingly on the topic*. ^ , ^^Tn 

It is unfortunate that some well-meaning persofis haye raised shiboleths in^the guise of 
philosophical issue^s. There is. not much doubt that all library administrators would 
like to offer all services without direct charge to the immediate user. Bpf when a 
service is needed {demanded) and normal sources of funds are not available, th^re is 



no other recourse. To charge is^ot to .deny service because we do offer the same 
service, albeit a slower ^rocedure^ The patrcSn makeiS his choice — cheap and slow p: 
fast and for a fee. We've done this for years. We have sold ink^r pens, ball 
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point pens;. writing paper and, more dramatically, have providfed phUacopying ser- - 
vices for a fee. At the same tinae, paper^and pencil have been available to facilitate 
manual copying. Choice - cheap and slow or fast and for a J^. 

Not only^^es chart;ing not deny access, it enhanqes access to those who do need it; 
It is mainly for in-depth, searching, not for simple reference questions.^/ As with 
photocopying, libraries l^ve found, and this study demonstrated, that controls must 
be imposed to prevent uitbridled and irresponsible utilization ot'tax dollar stor in- 
' appropriate* use of sendees, -e.g^, photocopying. 

Indeed, it is nof a simple question of charge or no charge. The very act of installing 
a terminal and the^ training of ataff to use it ;s a subsidy.' Despite the fact thaf the " 
issiies are really "hard business issues, librarians are hot prohibited from providing 
(on discretion) certain needed "fr^e" services. Subsidy can be Jmcreased in many* 
*ways and in 2fi infi^te number of degrees (up^.to total) when fund providers are per- 
suaded that terminals are more necessary thaft, j^or instance, garbage collection. / 



Costs are present, whether they are associated with manual or machine searching. 
A point tQ remember in thig context is that over a period oftifiae we havd often demon- 
*istrated that services previously thought to be expensive were reduced in price as 
' volume increased. As a result, librariesliave found that tiiey could foregb the direct 
charge, fox the service. From this study we cannot predict with c^ertaihty that history 
may be repeated here. But I think that subsidies will increase just as they have in^the 
case of coin^operated photocopying. 

'Staff attitude -was mentioned as an impact on the library." We found that the attitude 
of the library diyector was reflected in his staff, i;e., whetheij the terminal was 'an 
extra chore or provided enhanced service opportunities. We have made mistakes re- 
lating to staff acceptance of microfikn as a normal medium for storag^and trans- . 
mission of inforhiafion. Public acceptance of microfilm is reflected from lil^rarians' 
attitudes thajt/ye're sorry, &is is all we have, it's inconvenient and we don't like it, 

> • • i ■ • •< : 
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but you'll -have to get along/' Psyc|iologi€al and technical preparation is something 
that cannot be overlooked if any program is to be successful. ;User comments may 
possibly reflect negative^taff attitudes. 

Persons reading.the report of the study should examine carefully the opinions reported 
from both librsirians and users. Readers of the report should ask thelnselves what 
might have been the reason for the reactions whether positive or Negative. Unfortu- 
nately, the report of flie stujdy could have been more useful if^^e "evaluators had had 
some library experience or co-opted euch experience in order to ^^robe for signifi- 
cances behind^ the data and statements which they collected. 

. ' • • • 

The study did demonstrate that the ijiachine augmentation enhanced the ability of the 
librarians to perform in-depth reference worj^ more efficiently. The. studj^ found that 
these tools are good e?ctensions of printed indexes and'^abstrac ts. But - it was also 
demon^ated that the service, i.e. , terminals for searching, should be acquired 
selectively and cooperatively in the same manner that librarians now sefect and ac- 
quire printed versions of indexes. ' ^ , 

The study demonstrated •the potential, but did not naVe the opportunity to truly denK)n- 
strate, the real possibilitieg of ji^ailg^computeit assisted searches in a geographically 
dispersed area of library service.- In parallel studies (METRO) it has been shown that 
a central terminal installed on behalf of, and used ty many^ibraries, is feasible and 
useful. Only a lack of understanding of the service potential and' a lack of imaginative 
use of such service will hold back the extension of serVide; The public library is a 
linking agent as are air libraries. ^ ^ ~ ^ 
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J * . Appendix H '.^ ^.^ ' 

AVERA'GE COST OP^NLINE SEARCH 

A detailed study of the time Required to perform various elements of an online jsearch 
was inade by Cooper and D^Wath, ^s reported in Ref . 4 and iri the >P valuation Annex^ 
volume of this final report. This appendix sdmmarizes the cost data. 

H.l SEARCH ELEMENTS • , ^ ' 

' ' ' ' . 

, The search elements used by Cooper and DeWath were: 

- • Reference interview : time that the user spent negotiating the request with a 
* library staff member. ^ . ' 

„ • Originating library preparation : time in originating library to record, 

research, and record the request. 

• DIALOG library preparation; time spent ^on the request at the library per- 
forming the DIALOG search* witji ntf patron present and before performing 
^e online search;^ 

• Online search time : the actual DIALOG^ search-. 
DIALOG library followup : time spejft at the DIALOG library after the online 
search. with no jjatron present. * ' . . 
Originating library folloAyup : same as above, but at originating library. 
Followup with patron : at either the originating or the DIALOG library, the 

'time spent with^atron 4^1aining the results of the searcH. 



H.2 TIME AND gOST OF-SEARCK ELEMENTS/ , ^ 

The time required for e^h of ^hese elements is shown in Fig. H-i for the free and 
pay periods. , Because not ai^he elements are .performed for every search, a * ^ v 
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SEARCH ELEM ENTS 

^ REFERENCE INTERVIEW WfTH PATRG>N ' " , 
ORIGINATING LIBRARY PREPARATION TIME 
DIALOG LIBRARY PREPARATION TIME 
: ONLINE RETRIEVAL SERVICE COST • v 

" WNTING OF CITATIONS ^ 
SALARY COST FOR ONLINE*riME__ • • 

followup time for dialog library 
followup time for originating library 
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probability of e^ch element is shown. For example, the originating library seldom 
expends time preparing^^ search and therefore the probability of that element is 
low, 0. 11, while the p^Hpility of a reference interview is high, 0. 72. When .the 
cost of each search element is multiplied by.the corresponding probability, we pbtain 
ti^Q weighted cost shown in the right-most columns. 

The sumpf the^veighted costs* for the free period is $28.68 per search, and for the 
pay period is $26.44 per "search This deqrease in cost from the free to the .pay - 
period is due to the decrease in dhline search time from *23 to- 16 minutes. / 

Figure H-2 shows the costs grouped into "librarian salary," "online cost," "priat 
cost, " and -"tptals" for the free and pay periods^ It can b^ seen that the search ser- ' . 
vice costs represent about three-quarters of the total costof 'a search* 
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This appendix presents a list of the meetings hefd and indicates the kind of^oordinatioa^^ 
reqiiired in ar project SHch as this. A lisftof papers presegited indicates the dissemUia^*; 
tion of knowledge'conceming the project. « ^ 

1.1^* COORDINATION MEE'TII^GS ^ 



May 17, 1974. . Descfiptidi; of study to Cm'meetittgrPalaS^lto; C 

June 17 > 1974 Discjission. of agreepcrents with- participsiting library hea^s. The^e; ^ 
.agreements were to be signed by the re^e^^ive ^cities *tod (codnties, ^aind Lockheed. 

July 11 > 1974 . Applied Communidatioji Research made a prie^entatioa oon^rniivg the 
^data gathering plan at a tralmng;.session for the- librarians. • • . 



JuIy^O, 19^4. General meeting of pa'rticip^lng libraries ^^feuss'initial 

n ' ^v' ' ' • \ o-^*^ - V- 

with the system. 1.. ' ' • ^ * , ' . ;/ * . :r. '-"'^ , ' ' 
August' 2/ 1974 . Arrangements for, opemng^cereplonies^ , . " • • 

August 6, 1974 . Publicly Con£baittee%eeti^ at. which a iecomme^aa^tion w^S niade;; 



"to employ a publicity coo^fiiator," 



August 15, 197,4 . General •fifeettog bf partpipatipg^nbra^ disjJdss experien(ie to • 



date' and reyiew r^vteM ei^aliiatibn^plan. ' „ - '.-^ / 

August 22. 1974 . . Operiing Ceremonies il skxi' ' Josg^MIic L'itoary atten^d by city /■ 
dignitaries, City and County UTarariai^',. 

Augustus.' 197-4 . OyersighrCommiftee meeting ta;revle^^ '•■/''J l- 

S^ptembter 12. 1:974: The head^^f tfid-'pau^ipafeig libr'arieJ'^etHt tH& Sail. Mateo; ^ V^-: • ; 
'Educational Research CenterS(SMEpC) R.ej^joo^-CiV^c*' dis^^ V 



ing possible limitati6ns in the.i^X%^s>Sten^an*,the:poble of fee for servipe. r 
■ A Pricing Poli^Worl^ng Group was esfiabiia^ ,„ : 



latter question. ^ ' ! , ... • ''^^ ' y/- . it .A'- > V ' 



'' ^October 10; 1974 . 'Reference Ubraritan^ from, th^ paf ticipatlng llljrarip^ met ^^t the- 
•RedwQpd City library to disduss pubii9ity, the eyki^ion'^esUonnair^^ ^^tp^s^fe ;;4^ 
their experiences with the 'systen^ 



^'i, ...... f'-x.,- 
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October 24 > 1974 , Ferguson, Helmer, and Firschein met at Stanfprd to discuss the 
marketing effort status aAd strategy. Ih-library publicity was to' be stressed .until 
after January 1, a saturation canipaign was planned for .pne community in^J^uary - . 
Febnjary, atod^some in-library media presentations were consi'dered. 

f ptober 25 > 1974 , -.C/Mick and A. AMgren (ACR^ met with R. K. Summit and O, 
irschein to discuss the user questionnaire and me evaluatiofi^)la»^ - ^ -J 

t)ctober 27, 1974 , Fiances Grant conducted an additional training period for reference 
. .^^brarians of the participating libraries to bring tiiem up to date on some of the' new 
data 'bases and to show some advanced searcli techniques. 

November 21, 1974 . CIN Presentation, Skilling Auditorium, Stanford University ^ ' 
R, K. Summit^ O. Firschein, F. Grant, Lockheed; N.' DeWath, San Mateo County 
Library).*, . - 

V ' " . • • ' ' 

; January 16, 1975 . Meeting ol the librarians at Redwood City. The Coopel* /DeWath 
\ time study 'Was discussed and Alice Ahlgren pf ACR discussed the^ mechanics' of 
questionnaires. .^7^*^^* ^* , . i 

Febniai^y^, 1975. Meeting of Oversight Commi1;tee R^iew of ACR eval^atibn material 
and the fee-for-service policies to be used by the libraries. r- * 

March 19, 197l5 , Meeting at San Jose Public Library to. review the Cooper /DeWath 

March 1975 . Heads q£ libraries met and requested a subsidy because of unexpected' 

' ~" \i . *• 

personnel costs. ' ' . ' ^ . 

April'J, 1975 .' ^eeting wit^ heads of'Hbraries, CIN, .and Ldfckjieed in which a $10 per 
terminal hour subsidy was proposjed for submission to.NSF. 

"^ .June 1975 ^ Meeting of librarians to d^cuss pay period operation. 

^ • , ' • A ^ • • ' 

No^mber 24, 1975 ., Oversight Conqmittea meeting- concerning the need for planning 
for the third year of operation at full fee, the'ij^ed for follow-on studies of nonusers, 
aiid the.e^tinued collectioji of time and cost ^la. ' y ' a 

. "February 1976 . Site visit by ACR to out-of-state libraries participating in study.y 

June 3 > 197Q ,! (>ersi^t Conjm meeting to rp'iew first draft of final report. 

i 1 1-3 |.' -".^ . ■' ' 

o ■ . ■ ' ■ 183^ ■ ^ 

RIC • • • . . ' ; 

mmrn Lockheed palo alto rese>^rci^ laboratory . 
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June 1977 - October 1977 > The Oversight Committee individually reviewed drafts of 
the final ACR report and the Final Reports Cai:hart aniFirschein met in June', and 
Geller, Firschein, and Mick; Ferguson, Firschein, aip Mick; and Bourne and ; 
Firschein met in September. *Firschei|i and Mick mQt manjr times to review the eval- 



uation material *and to incorporate the comments and critiques into the ACR report, 
1.2 PRESENTATIONS AND PAPERS ' * ^ * 



»^Computerized Retrieval Comes to the Public Library, Oscar Firschein, Lockheed 
Information Systems; Evelyn Heliper^ Publicity Consultant; Sally Prew, Redwood City 
reference librarian; and Nancy DeWath, San Mateo County reference librarian, Bay,. 
Area Chapter of the American Society for InformatioiLScience, 12 Dec 1974 

'^Computerized Retrieval jn a Public Library Setting, 7 O. Firschein and R. K. Summit 
COMCON »75, IEEE Computer Soci*y, San Franciseo, California, Feb 1975 

'^Factors Affecting the Adoption bf^ Online petyice by the Public Library, Alice E. 
Ahlgren, ASIS Midyea^t!oynference, Portland', Oregon, Jun 1975 - ^ 

.'/Providing and Pricing Computerized Search in the Public Library, ^^^O^B^r Firschein 
and Roger Suna^mt, NSF colloquium, '^Strategies for ^Improving Special Library Effect- 
liveriess, Northwestern University, Jun 1975! ^ , 



» 'Online Retrieval m a Public Library Setting,^ Roger'Su^mit and Oscar Firschein, 
Special Libraries Association .meeting, Chicago,. Jun 1975^ * / , 

''The DIALIB Project," O. Firschein, Institut;^ on Library Service to* the Business 
Community, State University of New York,. Albanyi N.Y/,- Jun 19^5 

'^Online Search Services in the Public .Library: Project DIALIB," Alice'^;. Ahlgren, 
American Library. Association Ajmual Conference, Sin franciseo, California, 3 JuF 
1975 ' * 
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*^Prpviding the Public with Online Acceais to Large Bibliographic Data Bases/^ Oscar 
Firschein and Roger Summit, 2ndUSAyJapan Compute r^^J.^Bfi&rence, Tokyo, Japan, 
Aug, 19^5 \ l» ^ , / 4 . ' /^^^^ 

''The DIALIB Study, " Roger Suf^it/ 1975 Engineering Foundation Conference, 
Henniker, New. Hampshire, MAugi^TS " " I . , '] ' ^ 

"The Cost of On-Line Biblio^apmcteearohing/VM D. Xlooper, N. A. CeWath, , 
ACR-003-75-bl, Applied Communraation Reseaw^ December 1975 (published in a 
revised form in Journal of 'L|braryfAut<>maUon, r^ 9, .No. 3, S6p i'976, .ppv 195-208^* 

"On-Lin^ Reference Reurieval in ajPublic Library,*^ R. ^^^^ Si^mit and O. F^schein, 
Special Libraries , Feb' 1976 /pp> ^1-96 ^ - , / / • 

"Effects of Fee for Online' Reference Retrieval' in a Public Library Setting, D. ^ 
Firschein, and R. K, Summit, 67th Annual Special Libr^ri6s Association^ meeting, 
June 1976, Denver, Colorado. - 

t 



'Providing Fee for S^pe Online Searches^^Through the/ Public Library,*' A. Ahlgren, 
67th Annual Special Libraries Association'Meeting, Jun/l97&, Denver, Colorado. 

'»An Investigation of. the Public Library System as a LiAktog Agent to Major Sciehtific, • 
Educational,- Social, and Environmental Dat^ Bases, ^» 51. Summit ancf O. Firschein, 
National Science Foimdation,^ Division of, Science Information Seminar, "Alternatives 
.^td Traditidnal Information TTgpsfer Mechanisms, Washington; D. C. , Sep 28-29, - . 

. " . . • • ^ ■ ■ . j J. ^ 

"Online Reference Retrieval. in tlie Wblic Libc^: tessons /Learned, Firschein 
and B.. K. Summit, American Society for Information Science Annual Conference, 
San Francisco, California, Oct 4-9, 1976 ^ i \ ' . 

'."Online Use of ERIC? i^ a PiU^licS Library Setting, /R. Johnson (San Jos^^^J^IS: 
library) and O.' Firschein, ERIC UMpe Conf^enc^, San, Francisco^ Califotnia, 



ichei^, ERIC Usmb 



Oct 6, 1976. 
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ee for Service: EKct on Users, ".0. Firschein, National Science Fousjjation/Special 
Library Association Symposium, ^'^^uture of ^pecial Libraries," SX^ Annual Meeting,- 
New York, N.Y., Jun 1977 n ^ . / > 

"Online. Search in,tiie Public Library: Results of a Threp-Year Study ,-" ,0. ,Firschein 
and K. Sunimit, American Society for Information Science Annual Conference, 
^Chica^a, 111., Sep 1977 , [ ^ ^ 



"Public Xibrary Use of Ohline Bibliographic Retrievaly^ervipes:' Experienae^in Four 
Public Libraries in Northern Califo;rnia, " R. K. Summit aM Oscar Firsc^, 
ONLINE Magazine . Oct 1977 ♦ . ' ^ 



y 



^ "Input-0u1;put' Relationships in On-Line Bibliographic Searching," M. D. CoopeV, ' 
, Journal qf the American Society for Information Science , Vol. 28, No. 3, Maj/l977, 
pp. 153-160 . . ^ ■" 



"Eee-for Library Service: Effects on^Users," O. I^rschein*, Special ^Libi^ary 
I Association CpUoquium, "The ;^^uture of Special Library Resear^^tf^^ogress,^ 

Sponsored by the Divistpn qf Science Inform^tion^^ 'National Science Foundatipn, 
' New York, N.Y., Jun 1977 * A ' * 



"Online Search' in the Public Library: Results 
and R. K. Summit, 40th ASIS 4nnual Meeting^ Americ 
Science, Chicago, 111., Sep 1977 



9^ 



"Public Library Usie* of . inline -Biblio^aphic Services: Expe^nce in F^ur Public 
Libraries in Northern <^alifornia,"*R. K. Summit and 0.|Firscheih, ONLINE, Oct 
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